Byte Queue Parsing In High-Performance Network Messaging Architecture

ABSTRACT

A computationally-efficient system for encoding a message object implements instructions including determining a token of the message object. The token identifies a structure of the message object. The instructions include obtaining a dictionary definition based on the token. The dictionary definition describes the structure of the message. The message includes multiple entries. Each of the entries is characterized by a data type and a field identifier. The dictionary definition defines an order of the entries. The instructions include, according to an order specified by the dictionary definition, selecting each entry of a set of entries in the message in sequence and writing the entry to a byte queue exclusive of the data type and the field identifier. The instructions include initiating transmission of the byte queue over a communications network.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.17/379,269 filed Jul. 19, 2021, the entire disclosure of which isincorporated by reference.

FIELD

The present disclosure relates to high-performance messaging and moreparticularly to encoding, decoding, and distribution of messages acrosscommunications network.

BACKGROUND

Many environments require the exchange of information among differentparticipants. These participants may be clients, servers, applications,end-user devices, actuators, sensors, etc. When a high volume ofinformation needs to be transferred, performance issues such asbandwidth efficiency and processor overhead become more important.Generally, lower-level languages, such as C or even assembly, allow forvery efficient processing with low computational overhead. However,these low-level languages may require unique skill sets and be lessforgiving of any mistakes.

High-level languages may offer tremendous advantages in terms ofdeployability, portability, maintainability, and security. However, theadditional overhead imposed by high-level languages may result in slowercommunication with a given set of processing and network resources.Especially in situations where real-time or near-real-time performanceis needed, the trade-offs made by high-level languages may beunacceptable. Even when processing and network resources are increased,the overall communications throughput with a high-level language may besufficient, but the latency or jitter may be problematic.

Part of the deployability advantages of a high-level language is thatthe developers of business applications may be more comfortable andproficient interfacing with a communications platform using a languagesimilar to that of their business applications. For example, a businessdeveloper skilled in the Java programming language may be morecomfortable importing a Java communications library than attempting tointerface with a lower-level language.

While various approaches exist to translate or embed lower-levellanguages for use with high-level languages, these generally imposeperformance penalties over code natively running in the lower-levellanguage. Further, the boundary between the lower-level and high-levellanguages is often quite fragile.

SUMMARY

The summary is loosely divided into sections simply for organizationalpurposes. The concepts of each section can be combined with the conceptsof one or more other sections according to the principles of the presentdisclosure.

Memory Pooling

A memory management system includes memory hardware configured to storeinstructions and processing hardware configured to execute theinstructions stored by the memory hardware. The instructions includemaintaining a plurality of pool data structures. Each pool datastructure of the plurality of pool data structures is associated with arespective linked list of objects and includes a head pointer configuredto point to a first element in the linked list of objects. Theinstructions include, in response to a first object no longer beingneeded, recycling the first object by identifying a first pool datastructure, from the plurality of pool data structures, that correspondsto the first object and inserting the first object into a beginningposition of the linked list associated with the first pool datastructure without deallocating the memory for the first object. Theinstructions include, in response to a request for a new object from arequestor: identifying a second pool data structure from the pluralityof pool data structures according to a feature of the new object anddetermining whether the linked list associated with the second pool datastructure is empty. The instructions include, in response to the linkedlist not being empty: allocating memory for the new object, assigningthe new object to the second pool data structure, and returning the newobject to the requestor. The instructions include, in response to thelinked list not being empty: selecting a head object from the linkedlist, removing the head object from the linked list, and returning thehead object to the requestor as the new object. A state of the headobject is cleared prior to the head object being returned.

In other features, the first pool data structure is identified based ona data field of the first object. In other features, the data field isan object reference to the first pool data structure. In other features,each pool data structure of the plurality of pool data structures isassociated with a unique identifier. The data field stores the uniqueidentifier associated with the first pool data structure. In otherfeatures, inserting the first object into a beginning position of thelinked list includes: reading the head pointer of the first pool datastructure, configuring a pointer of the first element to be equal to thehead pointer of the first pool data structure, and selectively updatingthe head pointer of the first pool data structure to point to the firstobject.

In other features, selectively updating the head pointer is an atomicoperation performed only in response to the head pointer still beingequal to the pointer of the first object. In other features, selectingthe head object includes reading the head pointer of the second pooldata structure and identifying a target of the head pointer as the headobject. Removing the head object from the linked list includes reading apointer value of the head object and selectively updating the headpointer of the first pool data structure to be equal to the pointervalue. In other features, selectively updating the head pointer is anatomic operation performed only in response to the head pointer stillpointing to the head object.

In other features, the determining whether the linked list associatedwith the second pool data structure is empty is based on the headpointer of the second pool data structure such that the head pointerbeing null indicates the linked list is empty. In other features, theplurality of pool data structures includes a plurality of sets of pooldata structures. Each of the plurality of sets of pool data structurescorresponds to a respective object type. In other features, the objectis an instantiation of a first class of a plurality of classes. Theplurality of pool data structures includes a plurality of sets of pooldata structures. Each of the plurality of sets of pool data structurescorresponds to a respective one of the plurality of classes.

In other features, a first set of pool data structures corresponds to amessage object type. A second set of pool data structures corresponds toan array object type. In other features, a set of pool data structuresof the plurality of pool data structures corresponds one-to-one to arraysizes. The second pool data structure is further identified according toa requested size of the new object. In other features, the second poolstructure is identified by searching through a subset of the set of pooldata structures that correspond to array sizes greater than or equal tothe requested size.

In other features, the second pool structure is identified such that noother pool data structures of the set of pool data structures meet allthree of the following criteria: the corresponding array size of theother pool data structure is smaller than the corresponding array sizeof the second pool structure, the corresponding array size of the otherpool data structure is greater than or equal to the requested size, andthe linked list associated with the other pool data structure isnon-empty. In other features, a set of pool data structures of theplurality of pool data structures corresponds one-to-one to processingthreads. The second pool data structure is further identified accordingto an identity of a presently executing processing thread.

In other features, clearing the head object comprises iterating throughtop-level entries of the head object and setting a flag for each of theentries to indicate that valid data is absent. In other features, thetop-level entries of the head object are stored in an array. Iteratingthrough top-level entries of the head object includes iterating throughan array of the top-level entries of the head object. In other features,setting the flag for each entry of the entries includes setting aBoolean value of the entry to false. In other features, clearing thehead object is performed as the head object is recycled.

A non-transitory computer-readable medium stores instructions includingmaintaining a plurality of pool data structures. Each pool datastructure of the plurality of pool data structures is associated with arespective linked list of objects and includes a head pointer configuredto point to a first element in the linked list of objects. Theinstructions include, in response to a first object no longer beingneeded, recycling the first object by identifying a first pool datastructure, from the plurality of pool data structures, that correspondsto the first object and inserting the first object into a beginningposition of the linked list associated with the first pool datastructure without deallocating the memory for the first object. Theinstructions include, in response to a request for a new object from arequestor: identifying a second pool data structure from the pluralityof pool data structures according to a feature of the new object anddetermining whether the linked list associated with the second pool datastructure is empty. The instructions include, in response to the linkedlist not being empty: allocating memory for the new object, assigningthe new object to the second pool data structure, and returning the newobject to the requestor. The instructions include, in response to thelinked list not being empty: selecting a head object from the linkedlist, removing the head object from the linked list, and returning thehead object to the requestor as the new object. A state of the headobject is cleared prior to the head object being returned.

In other features, the first pool data structure is identified based ona data field of the first object. In other features, the data field isan object reference to the first pool data structure. In other features,each pool data structure of the plurality of pool data structures isassociated with a unique identifier. The data field stores the uniqueidentifier associated with the first pool data structure. In otherfeatures, inserting the first object into a beginning position of thelinked list includes: reading the head pointer of the first pool datastructure, configuring a pointer of the first element to be equal to thehead pointer of the first pool data structure, and selectively updatingthe head pointer of the first pool data structure to point to the firstobject.

In other features, selectively updating the head pointer is an atomicoperation performed only in response to the head pointer still beingequal to the pointer of the first object. In other features, selectingthe head object includes reading the head pointer of the second pooldata structure and identifying a target of the head pointer as the headobject. Removing the head object from the linked list includes reading apointer value of the head object and selectively updating the headpointer of the first pool data structure to be equal to the pointervalue. In other features, selectively updating the head pointer is anatomic operation performed only in response to the head pointer stillpointing to the head object.

In other features, the determining whether the linked list associatedwith the second pool data structure is empty is based on the headpointer of the second pool data structure such that the head pointerbeing null indicates the linked list is empty. In other features, theplurality of pool data structures includes a plurality of sets of pooldata structures. Each of the plurality of sets of pool data structurescorresponds to a respective object type. In other features, the objectis an instantiation of a first class of a plurality of classes. Theplurality of pool data structures includes a plurality of sets of pooldata structures. Each of the plurality of sets of pool data structurescorresponds to a respective one of the plurality of classes.

In other features, a first set of pool data structures corresponds to amessage object type. A second set of pool data structures corresponds toan array object type. In other features, a set of pool data structuresof the plurality of pool data structures corresponds one-to-one to arraysizes. The second pool data structure is further identified according toa requested size of the new object. In other features, the second poolstructure is identified by searching through a subset of the set of pooldata structures that correspond to array sizes greater than or equal tothe requested size.

In other features, the second pool structure is identified such that noother pool data structures of the set of pool data structures meet allthree of the following criteria: the corresponding array size of theother pool data structure is smaller than the corresponding array sizeof the second pool structure, the corresponding array size of the otherpool data structure is greater than or equal to the requested size, andthe linked list associated with the other pool data structure isnon-empty. In other features, a set of pool data structures of theplurality of pool data structures corresponds one-to-one to processingthreads. The second pool data structure is further identified accordingto an identity of a presently executing processing thread.

In other features, clearing the head object comprises iterating throughtop-level entries of the head object and setting a flag for each of theentries to indicate that valid data is absent. In other features, thetop-level entries of the head object are stored in an array. Iteratingthrough top-level entries of the head object includes iterating throughan array of the top-level entries of the head object. In other features,setting the flag for each entry of the entries includes setting aBoolean value of the entry to false. In other features, clearing thehead object is performed as the head object is recycled.

A method includes maintaining a plurality of pool data structures. Eachpool data structure of the plurality of pool data structures isassociated with a respective linked list of objects and includes a headpointer configured to point to a first element in the linked list ofobjects. The method includes, in response to a first object no longerbeing needed, recycling the first object by identifying a first pooldata structure, from the plurality of pool data structures, thatcorresponds to the first object and inserting the first object into abeginning position of the linked list associated with the first pooldata structure without deallocating the memory for the first object. Themethod includes, in response to a request for a new object from arequestor: identifying a second pool data structure from the pluralityof pool data structures according to a feature of the new object anddetermining whether the linked list associated with the second pool datastructure is empty. The method includes, in response to the linked listnot being empty: allocating memory for the new object, assigning the newobject to the second pool data structure, and returning the new objectto the requestor. The method includes, in response to the linked listnot being empty: selecting a head object from the linked list, removingthe head object from the linked list, and returning the head object tothe requestor as the new object. A state of the head object is clearedprior to the head object being returned.

In other features, the first pool data structure is identified based ona data field of the first object. In other features, the data field isan object reference to the first pool data structure. In other features,each pool data structure of the plurality of pool data structures isassociated with a unique identifier. The data field stores the uniqueidentifier associated with the first pool data structure. In otherfeatures, inserting the first object into a beginning position of thelinked list includes: reading the head pointer of the first pool datastructure, configuring a pointer of the first element to be equal to thehead pointer of the first pool data structure, and selectively updatingthe head pointer of the first pool data structure to point to the firstobject.

In other features, selectively updating the head pointer is an atomicoperation performed only in response to the head pointer still beingequal to the pointer of the first object. In other features, selectingthe head object includes reading the head pointer of the second pooldata structure and identifying a target of the head pointer as the headobject. Removing the head object from the linked list includes reading apointer value of the head object and selectively updating the headpointer of the first pool data structure to be equal to the pointervalue. In other features, selectively updating the head pointer is anatomic operation performed only in response to the head pointer stillpointing to the head object.

In other features, the determining whether the linked list associatedwith the second pool data structure is empty is based on the headpointer of the second pool data structure such that the head pointerbeing null indicates the linked list is empty. In other features, theplurality of pool data structures includes a plurality of sets of pooldata structures. Each of the plurality of sets of pool data structurescorresponds to a respective object type. In other features, the objectis an instantiation of a first class of a plurality of classes. Theplurality of pool data structures includes a plurality of sets of pooldata structures. Each of the plurality of sets of pool data structurescorresponds to a respective one of the plurality of classes.

In other features, a first set of pool data structures corresponds to amessage object type. A second set of pool data structures corresponds toan array object type. In other features, a set of pool data structuresof the plurality of pool data structures corresponds one-to-one to arraysizes. The second pool data structure is further identified according toa requested size of the new object. In other features, the second poolstructure is identified by searching through a subset of the set of pooldata structures that correspond to array sizes greater than or equal tothe requested size.

In other features, the second pool structure is identified such that noother pool data structures of the set of pool data structures meet allthree of the following criteria: the corresponding array size of theother pool data structure is smaller than the corresponding array sizeof the second pool structure, the corresponding array size of the otherpool data structure is greater than or equal to the requested size, andthe linked list associated with the other pool data structure isnon-empty. In other features, a set of pool data structures of theplurality of pool data structures corresponds one-to-one to processingthreads. The second pool data structure is further identified accordingto an identity of a presently executing processing thread.

In other features, clearing the head object comprises iterating throughtop-level entries of the head object and setting a flag for each of theentries to indicate that valid data is absent. In other features, thetop-level entries of the head object are stored in an array. Iteratingthrough top-level entries of the head object includes iterating throughan array of the top-level entries of the head object. In other features,setting the flag for each entry of the entries includes setting aBoolean value of the entry to false. In other features, clearing thehead object is performed as the head object is recycled.

Message Object Traversal

A communications system includes memory hardware configured to storeinstructions and processing hardware configured to execute theinstructions stored by the memory hardware. The instructions includemaintaining a message object that includes an array of entries and ahead pointer to a first active entry of the array of entries. Each entryof the array of entries includes a field identifier, a data type, and anext entry pointer. The head pointer and the series of next entrypointers establishes a linked list of entries. The instructions include,in response to a request to add a new entry to the message object,calculating an index of the array of entries based on a field identifierof the new entry and determining whether an active entry is present atthe calculated index in the array of entries. The instructions include,in response to the entry at the calculated index in the array of entriesbeing inactive: writing a data type of the new entry, the fieldidentifier of the new entry, and a data value of the new entry to theentry at the calculated index in the array of entries, and inserting thenew entry into the linked list of entries. The instructions include, inresponse to the entry at the calculated index in the array of entriesbeing active, selectively expanding the size of the array of entries andrepeating the calculating and determining.

In other features, the selectively expanding and repeating is onlyperformed when the field identifier of the new entry diverges from afield identifier of the entry at the calculated index in the array ofentries. In other features, the instructions include, in response to theentry at the calculated index in the array of entries being active andthe field identifier of the new entry equaling a field identifier of theentry at the calculated index in the array of entries, replacing a datavalue of the entry at the calculated index in the array of entries withthe data value of the new entry. In other features, the instructionsinclude, after expanding the size of the array of entries and repeatingthe calculating and determining, in response to the entry at thecalculated index in the array of entries still being active, selectivelyrepeating the expanding the size of the array of entries.

In other features, expanding the size of the array of entries includesallocating a new array and copying active entries from the array ofentries into the new array. In other features, for each active entrycopied over, an index into the new array is recalculated based on thefield identifier of the entry. In other features, the index of the arrayof entries is calculated based on a hash of the field identifier of thenew entry. In other features, N is the size of the array of entries. Thehash is a modulo N operation.

In other features, expanding the size of the array of entries comprisesdoubling the size of the array of entries. In other features, each entryof the array of entries includes a data value. In other features, foreach entry of the array of entries, a size of the data value is based onthe data type of the entry. In other features, each entry of the arrayof entries includes a Boolean flag indicating whether the entry isactive or not. In other features, the message object comprises a token.The token signifies a set of field identifiers present in the messageobject.

In other features, the communications system includes parsing themessage object according to the token by determining the set of fieldsaccording to the token and, for each field identifier of the set offield identifiers, calculating an index into the array of entries basedon the field identifier and accessing a data value of the entry locatedat the index in the array of entries. In other features, thecommunications system includes parsing the message object by traversingthe head pointer to select a first active entry in the array of entries,accessing a data value of the selected entry, and repeatedly following anext entry pointer of the selected entry to select another entry andaccessing a data value of the selected entry until the selected entry isa final entry in the linked list.

In other features, the selected entry is determined to be the finalentry in the linked list in response to the next active pointer of theselected entry. In other features, the selected entry is determined tobe the final entry in the linked list in response to the next activepointer of the selected entry being null. In other features, theinstructions include, in response to the data type of the new entrybeing an array, obtaining an array object. The array object comprises alength value and a backing array. The instructions include, in responseto a count of elements of the new entry exceeding a size of the backingarray, releasing the backing array, allocating a new backing array thatis larger than the backing array, setting the length value to the countof elements of the new entry, and storing the elements of the new entryinto the new backing array. The instructions include, in response to thecount of elements of the new entry being less than or equal to the sizeof the backing array, setting the length value to the count of elementsof the new entry, and storing the elements of the new entry into thebacking array.

In other features, the new backing array is twice as long as the backingarray. In other features, the instructions include, in response to arequest to add elements to the array, in response to a total count ofelements, including the added elements, exceeding the size of thebacking array: allocating a new backing array that is larger than thebacking array, copying elements, up to the length value, of the backingarray into the new backing array, setting the length value to the totalcount of elements, storing the added elements into the new backingarray, and releasing the backing array. The instructions include, inresponse to the count of elements of the new entry being less than orequal to the size of the backing array, setting the length value to thecount of elements of the new entry and storing the elements of the newentry into the backing array.

A non-transitory computer-readable medium stores instructions includingmaintaining a message object that includes an array of entries and ahead pointer to a first active entry of the array of entries. Each entryof the array of entries includes a field identifier, a data type, and anext entry pointer. The head pointer and the series of next entrypointers establishes a linked list of entries. The instructions include,in response to a request to add a new entry to the message object,calculating an index of the array of entries based on a field identifierof the new entry and determining whether an active entry is present atthe calculated index in the array of entries. The instructions include,in response to the entry at the calculated index in the array of entriesbeing inactive: writing a data type of the new entry, the fieldidentifier of the new entry, and a data value of the new entry to theentry at the calculated index in the array of entries, and inserting thenew entry into the linked list of entries. The instructions include, inresponse to the entry at the calculated index in the array of entriesbeing active, selectively expanding the size of the array of entries andrepeating the calculating and determining.

In other features, the selectively expanding and repeating is onlyperformed when the field identifier of the new entry diverges from afield identifier of the entry at the calculated index in the array ofentries. In other features, the instructions include, in response to theentry at the calculated index in the array of entries being active andthe field identifier of the new entry equaling a field identifier of theentry at the calculated index in the array of entries, replacing a datavalue of the entry at the calculated index in the array of entries withthe data value of the new entry. In other features, the instructionsinclude, after expanding the size of the array of entries and repeatingthe calculating and determining, in response to the entry at thecalculated index in the array of entries still being active, selectivelyrepeating the expanding the size of the array of entries.

In other features, expanding the size of the array of entries includesallocating a new array and copying active entries from the array ofentries into the new array. In other features, for each active entrycopied over, an index into the new array is recalculated based on thefield identifier of the entry. In other features, the index of the arrayof entries is calculated based on a hash of the field identifier of thenew entry. In other features, N is the size of the array of entries. Thehash is a modulo N operation.

In other features, expanding the size of the array of entries comprisesdoubling the size of the array of entries. In other features, each entryof the array of entries includes a data value. In other features, foreach entry of the array of entries, a size of the data value is based onthe data type of the entry. In other features, each entry of the arrayof entries includes a Boolean flag indicating whether the entry isactive or not. In other features, the message object comprises a token.The token signifies a set of field identifiers present in the messageobject.

In other features, the instructions include parsing the message objectaccording to the token by determining the set of fields according to thetoken and, for each field identifier of the set of field identifiers,calculating an index into the array of entries based on the fieldidentifier and accessing a data value of the entry located at the indexin the array of entries. In other features, the instructions includeparsing the message object by traversing the head pointer to select afirst active entry in the array of entries, accessing a data value ofthe selected entry, and repeatedly following a next entry pointer of theselected entry to select another entry and accessing a data value of theselected entry until the selected entry is a final entry in the linkedlist.

In other features, the selected entry is determined to be the finalentry in the linked list in response to the next active pointer of theselected entry. In other features, the selected entry is determined tobe the final entry in the linked list in response to the next activepointer of the selected entry being null. In other features, theinstructions include, in response to the data type of the new entrybeing an array, obtaining an array object. The array object comprises alength value and a backing array. The instructions include, in responseto a count of elements of the new entry exceeding a size of the backingarray, releasing the backing array, allocating a new backing array thatis larger than the backing array, setting the length value to the countof elements of the new entry, and storing the elements of the new entryinto the new backing array. The instructions include, in response to thecount of elements of the new entry being less than or equal to the sizeof the backing array, setting the length value to the count of elementsof the new entry, and storing the elements of the new entry into thebacking array.

In other features, the new backing array is twice as long as the backingarray. In other features, the instructions include, in response to arequest to add elements to the array, in response to a total count ofelements, including the added elements, exceeding the size of thebacking array: allocating a new backing array that is larger than thebacking array, copying elements, up to the length value, of the backingarray into the new backing array, setting the length value to the totalcount of elements, storing the added elements into the new backingarray, and releasing the backing array. The instructions include, inresponse to the count of elements of the new entry being less than orequal to the size of the backing array, setting the length value to thecount of elements of the new entry and storing the elements of the newentry into the backing array.

A method includes maintaining a message object that includes an array ofentries and a head pointer to a first active entry of the array ofentries. Each entry of the array of entries includes a field identifier,a data type, and a next entry pointer. The head pointer and the seriesof next entry pointers establishes a linked list of entries. The methodincludes, in response to a request to add a new entry to the messageobject, calculating an index of the array of entries based on a fieldidentifier of the new entry and determining whether an active entry ispresent at the calculated index in the array of entries. The methodincludes, in response to the entry at the calculated index in the arrayof entries being inactive: writing a data type of the new entry, thefield identifier of the new entry, and a data value of the new entry tothe entry at the calculated index in the array of entries, and insertingthe new entry into the linked list of entries. The method includes, inresponse to the entry at the calculated index in the array of entriesbeing active, selectively expanding the size of the array of entries andrepeating the calculating and determining.

In other features, the selectively expanding and repeating is onlyperformed when the field identifier of the new entry diverges from afield identifier of the entry at the calculated index in the array ofentries. In other features, the method includes, in response to theentry at the calculated index in the array of entries being active andthe field identifier of the new entry equaling a field identifier of theentry at the calculated index in the array of entries, replacing a datavalue of the entry at the calculated index in the array of entries withthe data value of the new entry. In other features, the method includes,after expanding the size of the array of entries and repeating thecalculating and determining, in response to the entry at the calculatedindex in the array of entries still being active, selectively repeatingthe expanding the size of the array of entries.

In other features, expanding the size of the array of entries includesallocating a new array and copying active entries from the array ofentries into the new array. In other features, for each active entrycopied over, an index into the new array is recalculated based on thefield identifier of the entry. In other features, the index of the arrayof entries is calculated based on a hash of the field identifier of thenew entry. In other features, N is the size of the array of entries. Thehash is a modulo N operation.

In other features, expanding the size of the array of entries comprisesdoubling the size of the array of entries. In other features, each entryof the array of entries includes a data value. In other features, foreach entry of the array of entries, a size of the data value is based onthe data type of the entry. In other features, each entry of the arrayof entries includes a Boolean flag indicating whether the entry isactive or not. In other features, the message object comprises a token.The token signifies a set of field identifiers present in the messageobject.

In other features, the method includes parsing the message objectaccording to the token by determining the set of fields according to thetoken and, for each field identifier of the set of field identifiers,calculating an index into the array of entries based on the fieldidentifier and accessing a data value of the entry located at the indexin the array of entries. In other features, the method includes parsingthe message object by traversing the head pointer to select a firstactive entry in the array of entries, accessing a data value of theselected entry, and repeatedly following a next entry pointer of theselected entry to select another entry and accessing a data value of theselected entry until the selected entry is a final entry in the linkedlist.

In other features, the selected entry is determined to be the finalentry in the linked list in response to the next active pointer of theselected entry. In other features, the selected entry is determined tobe the final entry in the linked list in response to the next activepointer of the selected entry being null. In other features, the methodincludes, in response to the data type of the new entry being an array,obtaining an array object. The array object comprises a length value anda backing array. The method includes, in response to a count of elementsof the new entry exceeding a size of the backing array, releasing thebacking array, allocating a new backing array that is larger than thebacking array, setting the length value to the count of elements of thenew entry, and storing the elements of the new entry into the newbacking array. The method includes, in response to the count of elementsof the new entry being less than or equal to the size of the backingarray, setting the length value to the count of elements of the newentry, and storing the elements of the new entry into the backing array.

In other features, the new backing array is twice as long as the backingarray. In other features, the method includes, in response to a requestto add elements to the array, in response to a total count of elements,including the added elements, exceeding the size of the backing array:allocating a new backing array that is larger than the backing array,copying elements, up to the length value, of the backing array into thenew backing array, setting the length value to the total count ofelements, storing the added elements into the new backing array, andreleasing the backing array. The method includes, in response to thecount of elements of the new entry being less than or equal to the sizeof the backing array, setting the length value to the count of elementsof the new entry and storing the elements of the new entry into thebacking array.

Immutable Object Handling

A computationally-efficient object conversion system includes memoryhardware configured to store instructions and processing hardwareconfigured to execute the instructions stored by the memory hardware.The instructions include maintaining a plurality of objects. Each objectof the plurality of objects includes an array of characters and a hashvalue. The instructions include maintaining a plurality of strings in aone-to-one relationship with the plurality of objects. The instructionsinclude, for each object of the plurality of objects, calculating thehash value in response to values being written to the array ofcharacters of the object. The instructions include defining an equalsmethod that, for first and second objects of the plurality of objects,returns a true value in response to values of the array of characters ofthe first object matching values of the array of characters of thesecond object. The instructions include defining a hash method that, fora selected object of the plurality of objects, returns the hash value ofthe selected object. The instructions include, in response to a requestincluding a request string, determining whether one of the plurality ofstrings is equal to the request string and, in response to determiningthat one of the plurality of strings is equal to the request string,returning the object of the plurality of objects related to the one ofthe plurality of strings.

In other features, the system includes, in response to the request andfurther in response to determining that none of the plurality of objectscorresponds to the request string: adding a new object to the pluralityof objects, writing values to the array of characters of the new objectbased on the string, adding the request string to the plurality ofstrings, relating the request string in the plurality of strings to thenew object in the plurality of objects, and returning the new object. Inother features, the system includes maintaining a data store ofkey-value pairs including the plurality of objects as the values and theplurality of strings as the keys. In other features, the data store isimplemented as a hashmap.

In other features, each object of the plurality of objects includes alength value. The equals method, for the first and second objects,returns a false value in response to the length value of the firstobject not matching the length value of the second object. In otherfeatures, the equals method, for the first and second objects, ignoresvalues of the array of characters of the first object having indicesgreater than the length value of the first object and ignores values ofthe array of characters of the second object having indices greater thanthe length value of the second object. In other features, each of thecharacters is encoded as a signed byte or according to one of UTF-8 andUTF-16. In other features, returning the one of the plurality of objectsincludes returning a reference to the one of the plurality of objects.

A computationally-efficient object conversion system includes memoryhardware configured to store instructions and processing hardwareconfigured to execute the instructions stored by the memory hardware.The instructions include maintaining a plurality of objects. Each objectof the plurality of objects includes an array of characters and a hashvalue. The instructions include maintaining a plurality of strings in aone-to-one relationship with the plurality of objects. The instructionsinclude, for each object of the plurality of objects, calculating thehash value in response to values being written to the array ofcharacters of the object. The instructions include defining an equalsmethod that, for first and second objects of the plurality of objects,returns a true value in response to values of the array of characters ofthe first object matching values of the array of characters of thesecond object. The instructions include defining a hash method that, fora selected object of the plurality of objects, returns the hash value ofthe selected object. The instructions include, in response to a requestincluding a request object: using the equals method, determining whetherone of the plurality of objects is equal to the request object and, inresponse to determining that one of the plurality of objects equals therequest object, returning the string from the plurality of strings thatis related to the one of the plurality of objects.

In other features, the system includes, in response to the request andfurther in response to determining that none of the plurality of objectsequals the request object: adding a new object to the plurality ofobjects, writing values to the array of characters of the new objectbased on the request object, converting the request object into a newstring, adding the new string to the plurality of strings, and returningthe new string. In other features, the system includes maintaining adata store of key-value pairs including the plurality of objects as thekeys and the plurality of strings as the values. In other features, thedata store is implemented as a hashmap.

In other features, each object of the plurality of objects includes alength value. The equals method, for the first and second objects,returns a false value in response to the length value of the firstobject not matching the length value of the second object. In otherfeatures, the equals method, for the first and second objects, ignoresvalues of the array of characters of the first object having indicesgreater than the length value of the first object and ignores values ofthe array of characters of the second object having indices greater thanthe length value of the second object. In other features, each of thecharacters is encoded as a signed byte or according to one of UTF-8 andUTF-16.

A non-transitory computer-readable medium stores instructions includingmaintaining a plurality of objects. Each object of the plurality ofobjects includes an array of characters and a hash value. Theinstructions include maintaining a plurality of strings in a one-to-onerelationship with the plurality of objects. The instructions include,for each object of the plurality of objects, calculating the hash valuein response to values being written to the array of characters of theobject. The instructions include defining an equals method that, forfirst and second objects of the plurality of objects, returns a truevalue in response to values of the array of characters of the firstobject matching values of the array of characters of the second object.The instructions include defining a hash method that, for a selectedobject of the plurality of objects, returns the hash value of theselected object. The instructions include, in response to a requestincluding a request string, determining whether one of the plurality ofstrings is equal to the request string and, in response to determiningthat one of the plurality of strings is equal to the request string,returning the object of the plurality of objects related to the one ofthe plurality of strings.

In other features, the instructions include, in response to the requestand further in response to determining that none of the plurality ofobjects corresponds to the request string: adding a new object to theplurality of objects, writing values to the array of characters of thenew object based on the string, adding the request string to theplurality of strings, relating the request string in the plurality ofstrings to the new object in the plurality of objects, and returning thenew object. In other features, the instructions include maintaining adata store of key-value pairs including the plurality of objects as thevalues and the plurality of strings as the keys. In other features, thedata store is implemented as a hashmap.

In other features, each object of the plurality of objects includes alength value. The equals method, for the first and second objects,returns a false value in response to the length value of the firstobject not matching the length value of the second object. In otherfeatures, the equals method, for the first and second objects, ignoresvalues of the array of characters of the first object having indicesgreater than the length value of the first object and ignores values ofthe array of characters of the second object having indices greater thanthe length value of the second object. In other features, each of thecharacters is encoded as a signed byte or according to one of UTF-8 andUTF-16. In other features, returning the one of the plurality of objectsincludes returning a reference to the one of the plurality of objects.

A non-transitory computer-readable medium stores instructions includingmaintaining a plurality of objects. Each object of the plurality ofobjects includes an array of characters and a hash value. Theinstructions include maintaining a plurality of strings in a one-to-onerelationship with the plurality of objects. The instructions include,for each object of the plurality of objects, calculating the hash valuein response to values being written to the array of characters of theobject. The instructions include defining an equals method that, forfirst and second objects of the plurality of objects, returns a truevalue in response to values of the array of characters of the firstobject matching values of the array of characters of the second object.The instructions include defining a hash method that, for a selectedobject of the plurality of objects, returns the hash value of theselected object. The instructions include, in response to a requestincluding a request object: using the equals method, determining whetherone of the plurality of objects is equal to the request object and, inresponse to determining that one of the plurality of objects equals therequest object, returning the string from the plurality of strings thatis related to the one of the plurality of objects.

In other features, the instructions include, in response to the requestand further in response to determining that none of the plurality ofobjects equals the request object: adding a new object to the pluralityof objects, writing values to the array of characters of the new objectbased on the request object, converting the request object into a newstring, adding the new string to the plurality of strings, and returningthe new string. In other features, the instructions include maintaininga data store of key-value pairs including the plurality of objects asthe keys and the plurality of strings as the values. In other features,the data store is implemented as a hashmap.

In other features, each object of the plurality of objects includes alength value. The equals method, for the first and second objects,returns a false value in response to the length value of the firstobject not matching the length value of the second object. In otherfeatures, the equals method, for the first and second objects, ignoresvalues of the array of characters of the first object having indicesgreater than the length value of the first object and ignores values ofthe array of characters of the second object having indices greater thanthe length value of the second object. In other features, each of thecharacters is encoded as a signed byte or according to one of UTF-8 andUTF-16.

A method includes maintaining a plurality of objects. Each object of theplurality of objects includes an array of characters and a hash value.The method includes maintaining a plurality of strings in a one-to-onerelationship with the plurality of objects. The method includes, foreach object of the plurality of objects, calculating the hash value inresponse to values being written to the array of characters of theobject. The method includes defining an equals method that, for firstand second objects of the plurality of objects, returns a true value inresponse to values of the array of characters of the first objectmatching values of the array of characters of the second object. Themethod includes defining a hash method that, for a selected object ofthe plurality of objects, returns the hash value of the selected object.The method includes, in response to a request including a requeststring, determining whether one of the plurality of strings is equal tothe request string and, in response to determining that one of theplurality of strings is equal to the request string, returning theobject of the plurality of objects related to the one of the pluralityof strings.

In other features, the system includes, in response to the request andfurther in response to determining that none of the plurality of objectscorresponds to the request string: adding a new object to the pluralityof objects, writing values to the array of characters of the new objectbased on the string, adding the request string to the plurality ofstrings, relating the request string in the plurality of strings to thenew object in the plurality of objects, and returning the new object. Inother features, the system includes maintaining a data store ofkey-value pairs including the plurality of objects as the values and theplurality of strings as the keys. In other features, the data store isimplemented as a hashmap.

In other features, each object of the plurality of objects includes alength value. The equals method, for the first and second objects,returns a false value in response to the length value of the firstobject not matching the length value of the second object. In otherfeatures, the equals method, for the first and second objects, ignoresvalues of the array of characters of the first object having indicesgreater than the length value of the first object and ignores values ofthe array of characters of the second object having indices greater thanthe length value of the second object. In other features, each of thecharacters is encoded as a signed byte or according to one of UTF-8 andUTF-16. In other features, returning the one of the plurality of objectsincludes returning a reference to the one of the plurality of objects.

A method includes maintaining a plurality of objects. Each object of theplurality of objects includes an array of characters and a hash value.The method includes maintaining a plurality of strings in a one-to-onerelationship with the plurality of objects. The method includes, foreach object of the plurality of objects, calculating the hash value inresponse to values being written to the array of characters of theobject. The method includes defining an equals method that, for firstand second objects of the plurality of objects, returns a true value inresponse to values of the array of characters of the first objectmatching values of the array of characters of the second object. Themethod includes defining a hash method that, for a selected object ofthe plurality of objects, returns the hash value of the selected object.The method includes, in response to a request including a requestobject: using the equals method, determining whether one of theplurality of objects is equal to the request object and, in response todetermining that one of the plurality of objects equals the requestobject, returning the string from the plurality of strings that isrelated to the one of the plurality of objects.

In other features, the system includes, in response to the request andfurther in response to determining that none of the plurality of objectsequals the request object: adding a new object to the plurality ofobjects, writing values to the array of characters of the new objectbased on the request object, converting the request object into a newstring, adding the new string to the plurality of strings, and returningthe new string. In other features, the system includes maintaining adata store of key-value pairs including the plurality of objects as thekeys and the plurality of strings as the values. In other features, thedata store is implemented as a hashmap.

In other features, each object of the plurality of objects includes alength value. The equals method, for the first and second objects,returns a false value in response to the length value of the firstobject not matching the length value of the second object. In otherfeatures, the equals method, for the first and second objects, ignoresvalues of the array of characters of the first object having indicesgreater than the length value of the first object and ignores values ofthe array of characters of the second object having indices greater thanthe length value of the second object. In other features, each of thecharacters is encoded as a signed byte or according to one of UTF-8 andUTF-16.

Encoder Parsing

A computationally-efficient encoding system for encoding a messageobject includes memory hardware configured to store instructions andprocessing hardware configured to execute the instructions stored by thememory hardware. The instructions include determining a token of themessage object. The token uniquely identifies a structure of the messageobject. The instructions include obtaining a dictionary definition basedon the token. The dictionary definition describes the structure of themessage. The message includes a plurality of entries. Each of theplurality of entries is characterized by a data type and a fieldidentifier. The dictionary definition defines an order of the pluralityof entries. The instructions include, according to an order specified bythe dictionary definition, selecting each entry of a plurality ofentries in the message in sequence and writing the entry to a byte queueexclusive of the data type and the field identifier. The instructionsinclude initiating transmission of the byte queue over a communicationsnetwork.

In other features, the writing the entry to the byte queue includes, inresponse to the entry being one of a set of primitive data types,writing a value of the entry to the byte queue. In other features, theset of primitive data types includes Boolean, byte, char, short, int,long, float, and double. In other features, the writing the entry to thebyte queue includes, in response to the entry being an array, writing alength of the array to the byte queue exclusive of a data type of thearray and writing each element of the array to the byte queue.

In other features, the writing the entry to the byte queue includes, inresponse to the entry being a nested message, recursively performing theselecting and writing for entries in the nested message. In otherfeatures, the dictionary definition defines, for each of the pluralityof entries, a data type. The dictionary definition defines, for each ofthe plurality of entries, a field identifier. In other features, thesystem includes storing a plurality of dictionary entries having aone-to-one relationship with a plurality of tokens. In other features,the system includes synchronizing the plurality of dictionary entrieswith a dictionary server over the communications network.

In other features, initiating transmission of the byte queue includes,in response to the byte queue having a length less than or equal to athreshold, sending the byte queue to a networking stack for transmissionas a packet. Initiating transmission includes, in response to the lengthof the byte queue exceeding the threshold, iteratively obtaining,without replacement, a number of bytes less than or equal to thethreshold from the byte queue, and sending the obtained bytes to thenetworking stack for transmission as a packet. In other features, thesending the obtained bytes to the networking stack includes sending atotal packet count as well as a current packet number to the networkingstack. In other features, the packet is one of a user datagram protocol(UDP) datagram and a transmission control protocol (TCP) segment.

In other features, in response to a transmission mode being userdatagram protocol (UDP), initiating transmission of the byte queueincludes, in response to the byte queue having a length less than orequal to a threshold, sending first header data and the byte queue to anetworking stack for transmission as a packet. Initiating transmissionincludes, in response to the length of the byte queue exceeding thethreshold, iteratively obtaining, without replacement, a number of bytesless than or equal to the threshold from the byte queue, and sendingsecond header data and the obtained bytes to the networking stack fortransmission as a packet. The first header data has a different lengththan the second header data. The first header data includes a fixedvalue indicating that an entirety of the message is contained in thepacket.

In other features, the first header data is a single byte. The firstheader data consists of the fixed value. In other features, the secondheader data includes an identifier of the message, a total number ofpackets, and a serial number of the packet with respect to the totalnumber of packets. In other features, the threshold is based on adifference between (i) a largest UDP data payload available throughoutthe communications network and (ii) the length of the first header data.In other features, in response to the transmission mode being userdatagram protocol (UDP), initiating transmission of the byte queueincludes: in response to the length of the byte queue being less than orequal to the threshold, freeing the byte queue for reuse immediatelyupon sending the byte queue to the networking stack; and in response tothe length of the byte queue exceeding the threshold, retaining the bytequeue for a defined re-request time before freeing the byte queue forreuse.

In other features, the system is configured to operate in two selectablemodes. The two selectable modes include a dictionary mode and a plenarymode. The instructions include, in the plenary mode, according to anorder established by the structure of the message object, selecting eachentry of the plurality of entries in the message in sequence and, forthat entry, writing the data type of the entry to the byte queue,writing the field identifier of the entry to the byte queue, and writingthe entry to the byte queue. In other features, the order in the plenarymode is established by a linked list of the plurality of entries. Inother features, the message object includes a head pointer pointing to afirst one of the plurality of entries. Each of the plurality of entrieshas a next pointer to indicate a next entry in the linked list.

A computationally-efficient encoding method for encoding a messageobject includes determining a token of the message object. The tokenuniquely identifies a structure of the message object. The methodincludes obtaining a dictionary definition based on the token. Thedictionary definition describes the structure of the message. Themessage includes a plurality of entries. Each of the plurality ofentries is characterized by a data type and a field identifier. Thedictionary definition defines an order of the plurality of entries. Themethod includes, according to an order specified by the dictionarydefinition, selecting each entry of a plurality of entries in themessage in sequence and writing the entry to a byte queue exclusive ofthe data type and the field identifier. The method includes initiatingtransmission of the byte queue over a communications network.

In other features, the writing the entry to the byte queue includes, inresponse to the entry being one of a set of primitive data types,writing a value of the entry to the byte queue. In other features, theset of primitive data types includes Boolean, byte, char, short, int,long, float, and double. In other features, the writing the entry to thebyte queue includes, in response to the entry being an array, writing alength of the array to the byte queue exclusive of a data type of thearray and writing each element of the array to the byte queue.

In other features, the writing the entry to the byte queue includes, inresponse to the entry being a nested message, recursively performing theselecting and writing for entries in the nested message. In otherfeatures, the dictionary definition defines, for each of the pluralityof entries, a data type. The dictionary definition defines, for each ofthe plurality of entries, a field identifier. In other features, themethod includes storing a plurality of dictionary entries having aone-to-one relationship with a plurality of tokens. In other features,the method includes synchronizing the plurality of dictionary entrieswith a dictionary server over the communications network.

In other features, initiating transmission of the byte queue includes,in response to the byte queue having a length less than or equal to athreshold, sending the byte queue to a networking stack for transmissionas a packet. Initiating transmission includes, in response to the lengthof the byte queue exceeding the threshold, iteratively obtaining,without replacement, a number of bytes less than or equal to thethreshold from the byte queue, and sending the obtained bytes to thenetworking stack for transmission as a packet. In other features, thesending the obtained bytes to the networking stack includes sending atotal packet count as well as a current packet number to the networkingstack. In other features, the packet is one of a user datagram protocol(UDP) datagram and a transmission control protocol (TCP) segment.

In other features, in response to a transmission mode being userdatagram protocol (UDP), initiating transmission of the byte queueincludes, in response to the byte queue having a length less than orequal to a threshold, sending first header data and the byte queue to anetworking stack for transmission as a packet. Initiating transmissionincludes, in response to the length of the byte queue exceeding thethreshold, iteratively obtaining, without replacement, a number of bytesless than or equal to the threshold from the byte queue, and sendingsecond header data and the obtained bytes to the networking stack fortransmission as a packet. The first header data has a different lengththan the second header data. The first header data includes a fixedvalue indicating that an entirety of the message is contained in thepacket.

In other features, the first header data is a single byte. The firstheader data consists of the fixed value. In other features, the secondheader data includes an identifier of the message, a total number ofpackets, and a serial number of the packet with respect to the totalnumber of packets. In other features, the threshold is based on adifference between (i) a largest UDP data payload available throughoutthe communications network and (ii) the length of the first header data.In other features, in response to the transmission mode being userdatagram protocol (UDP), initiating transmission of the byte queueincludes: in response to the length of the byte queue being less than orequal to the threshold, freeing the byte queue for reuse immediatelyupon sending the byte queue to the networking stack; and in response tothe length of the byte queue exceeding the threshold, retaining the bytequeue for a defined re-request time before freeing the byte queue forreuse.

In other features, the method is configured to operate in two selectablemodes. The two selectable modes include a dictionary mode and a plenarymode. The method includes, in the plenary mode, according to an orderestablished by the structure of the message object, selecting each entryof the plurality of entries in the message in sequence and, for thatentry, writing the data type of the entry to the byte queue, writing thefield identifier of the entry to the byte queue, and writing the entryto the byte queue. In other features, the order in the plenary mode isestablished by a linked list of the plurality of entries. In otherfeatures, the message object includes a head pointer pointing to a firstone of the plurality of entries. Each of the plurality of entries has anext pointer to indicate a next entry in the linked list.

A non-transitory computer-readable medium stores instructions includingdetermining a token of the message object. The token uniquely identifiesa structure of the message object. The instructions include obtaining adictionary definition based on the token. The dictionary definitiondescribes the structure of the message. The message includes a pluralityof entries. Each of the plurality of entries is characterized by a datatype and a field identifier. The dictionary definition defines an orderof the plurality of entries. The instructions include, according to anorder specified by the dictionary definition, selecting each entry of aplurality of entries in the message in sequence and writing the entry toa byte queue exclusive of the data type and the field identifier. Theinstructions include initiating transmission of the byte queue over acommunications network.

In other features, the writing the entry to the byte queue includes, inresponse to the entry being one of a set of primitive data types,writing a value of the entry to the byte queue. In other features, theset of primitive data types includes Boolean, byte, char, short, int,long, float, and double. In other features, the writing the entry to thebyte queue includes, in response to the entry being an array, writing alength of the array to the byte queue exclusive of a data type of thearray and writing each element of the array to the byte queue.

In other features, the writing the entry to the byte queue includes, inresponse to the entry being a nested message, recursively performing theselecting and writing for entries in the nested message. In otherfeatures, the dictionary definition defines, for each of the pluralityof entries, a data type. The dictionary definition defines, for each ofthe plurality of entries, a field identifier. In other features, theinstructions includes storing a plurality of dictionary entries having aone-to-one relationship with a plurality of tokens. In other features,the instructions include synchronizing the plurality of dictionaryentries with a dictionary server over the communications network.

In other features, initiating transmission of the byte queue includes,in response to the byte queue having a length less than or equal to athreshold, sending the byte queue to a networking stack for transmissionas a packet. Initiating transmission includes, in response to the lengthof the byte queue exceeding the threshold, iteratively obtaining,without replacement, a number of bytes less than or equal to thethreshold from the byte queue, and sending the obtained bytes to thenetworking stack for transmission as a packet. In other features, thesending the obtained bytes to the networking stack includes sending atotal packet count as well as a current packet number to the networkingstack. In other features, the packet is one of a user datagram protocol(UDP) datagram and a transmission control protocol (TCP) segment.

In other features, in response to a transmission mode being userdatagram protocol (UDP), initiating transmission of the byte queueincludes, in response to the byte queue having a length less than orequal to a threshold, sending first header data and the byte queue to anetworking stack for transmission as a packet. Initiating transmissionincludes, in response to the length of the byte queue exceeding thethreshold, iteratively obtaining, without replacement, a number of bytesless than or equal to the threshold from the byte queue, and sendingsecond header data and the obtained bytes to the networking stack fortransmission as a packet. The first header data has a different lengththan the second header data. The first header data includes a fixedvalue indicating that an entirety of the message is contained in thepacket.

In other features, the first header data is a single byte. The firstheader data consists of the fixed value. In other features, the secondheader data includes an identifier of the message, a total number ofpackets, and a serial number of the packet with respect to the totalnumber of packets. In other features, the threshold is based on adifference between (i) a largest UDP data payload available throughoutthe communications network and (ii) the length of the first header data.In other features, in response to the transmission mode being userdatagram protocol (UDP), initiating transmission of the byte queueincludes: in response to the length of the byte queue being less than orequal to the threshold, freeing the byte queue for reuse immediatelyupon sending the byte queue to the networking stack; and in response tothe length of the byte queue exceeding the threshold, retaining the bytequeue for a defined re-request time before freeing the byte queue forreuse.

In other features, the instructions include providing two selectablemodes. The two selectable modes include a dictionary mode and a plenarymode. The instructions include, in the plenary mode, according to anorder established by the structure of the message object, selecting eachentry of the plurality of entries in the message in sequence and, forthat entry, writing the data type of the entry to the byte queue,writing the field identifier of the entry to the byte queue, and writingthe entry to the byte queue. In other features, the order in the plenarymode is established by a linked list of the plurality of entries. Inother features, the message object includes a head pointer pointing to afirst one of the plurality of entries. Each of the plurality of entrieshas a next pointer to indicate a next entry in the linked list.

Decoder Parsing

A decoding system for recovering a message object from a byte queuereceived over a communications network includes memory hardwareconfigured to store instructions and processing hardware configured toexecute the instructions stored by the memory hardware. The instructionsinclude reading a token of the message object from the byte queue. Thetoken uniquely identifies a structure of the message object. Theinstructions include obtaining a dictionary definition based on thetoken. The dictionary definition defines a plurality of entries in adefined order including, for each entry of the plurality of entries, adata type and a field identifier. The instructions include iteratingover the dictionary definition in the defined order and, for each entryof the plurality of entries, reading a number of bytes from the bytequeue, selecting an entry of the message object according to the fieldidentifier of the entry, and writing the number of bytes to the selectedentry of the message object. The number is defined by the data type ofthe entry.

In other features, the iterating includes, for each entry of theplurality of entries, writing the data type of the entry to the selectedentry. In other features, the iterating includes, for each entry of theplurality of entries, writing the field identifier of the entry to theselected entry. In other features, the iterating includes, for eachentry of the plurality of entries, setting a flag for the selected entryto indicate valid data is present. In other features, the writing thenumber of bytes to the selected entry of the message object includes, inresponse to the selected entry being a nested message, recursivelyperforming the iterating for entries in the nested message. In otherfeatures, the system includes storing a plurality of dictionary entrieshaving a one-to-one relationship with a plurality of tokens.

In other features, the system includes synchronizing the plurality ofdictionary entries with a dictionary server over the communicationsnetwork. In other features, the instructions include, for user datagramprotocol (UDP) communication, determining whether a received packet isonly part of the message object. The instructions include, in responseto determining that the received packet is only part of the messageobject, copying the received packet to a multi-packet data structure.The instructions include encoding a total number of packets in themulti-packet data structure. The instructions include, in response tothe total number of packets being copied to the multi-packet datastructure, copying each portion of the multi-packet data structure, inpacket order, into the byte queue returning the multi-packet datastructure to an inactive status, and initiating the reading, theobtaining, and the iterating on the byte queue.

In other features, the instructions include, for user datagram protocol(UDP) communication, selectively identifying a moribund multi-packetdata structure that has received no additional packets for a firstthreshold period of time; and, in response to identifying the moribundmulti-packet data structure, sending a retransmit request to atransmission source of the packets in the moribund multi-packet datastructure. In other features, the retransmit request identifies specificpacket numbers missing from the moribund multi-packet data structure.The instructions include, for user datagram protocol (UDP)communication, selectively identifying an expired multi-packet datastructure that has received no additional packets for a second thresholdperiod of time. The second threshold period of time is longer than thefirst threshold period of time. The instructions include, in response toidentifying the expired multi-packet data structure, returning theexpired multi-packet data structure to an inactive status.

In other features, the system is configured to operate in two selectablemodes. The two selectable modes include a dictionary mode and a plenarymode. The instructions include, in the plenary mode, reading a fieldidentifier and a data type from the byte queue, selecting an entry ofthe message object according to the field identifier, copying a numberof bytes from the byte queue to the selected entry of the messageobject, and repeating the reading, selecting, and copying until the bytequeue is exhausted. The number is defined by the data type. In otherfeatures, the instructions include, in the plenary mode, for eachselected entry of the message object, setting a next pointer for thepreviously selected entry to point to the selected entry. In otherfeatures, in the plenary mode, the copying the number of bytes from thebyte queue to the selected entry includes, in response to the data typebeing a nested message, recursively invoking the reading, the selecting,and the copying on the nested message.

A method for recovering a message object from a byte queue received overa communications network includes reading a token of the message objectfrom the byte queue. The token uniquely identifies a structure of themessage object. The method includes obtaining a dictionary definitionbased on the token. The dictionary definition defines a plurality ofentries in a defined order including, for each entry of the plurality ofentries, a data type and a field identifier. The method includesiterating over the dictionary definition in the defined order and, foreach entry of the plurality of entries, reading a number of bytes fromthe byte queue, selecting an entry of the message object according tothe field identifier of the entry, and writing the number of bytes tothe selected entry of the message object. The number is defined by thedata type of the entry.

In other features, the iterating includes, for each entry of theplurality of entries, writing the data type of the entry to the selectedentry. In other features, the iterating includes, for each entry of theplurality of entries, writing the field identifier of the entry to theselected entry. In other features, the iterating includes, for eachentry of the plurality of entries, setting a flag for the selected entryto indicate valid data is present. In other features, the writing thenumber of bytes to the selected entry of the message object includes, inresponse to the selected entry being a nested message, recursivelyperforming the iterating for entries in the nested message. In otherfeatures, the method includes storing a plurality of dictionary entrieshaving a one-to-one relationship with a plurality of tokens.

In other features, the method includes synchronizing the plurality ofdictionary entries with a dictionary server over the communicationsnetwork. In other features, the method includes, for user datagramprotocol (UDP) communication, determining whether a received packet isonly part of the message object. The method includes, in response todetermining that the received packet is only part of the message object,copying the received packet to a multi-packet data structure. The methodincludes encoding a total number of packets in the multi-packet datastructure. The method includes, in response to the total number ofpackets being copied to the multi-packet data structure, copying eachportion of the multi-packet data structure, in packet order, into thebyte queue returning the multi-packet data structure to an inactivestatus, and initiating the reading, the obtaining, and the iterating onthe byte queue.

In other features, the method includes, for user datagram protocol (UDP)communication, selectively identifying a moribund multi-packet datastructure that has received no additional packets for a first thresholdperiod of time; and, in response to identifying the moribundmulti-packet data structure, sending a retransmit request to atransmission source of the packets in the moribund multi-packet datastructure. In other features, the retransmit request identifies specificpacket numbers missing from the moribund multi-packet data structure.The method includes, for user datagram protocol (UDP) communication,selectively identifying an expired multi-packet data structure that hasreceived no additional packets for a second threshold period of time.The second threshold period of time is longer than the first thresholdperiod of time. The method includes, in response to identifying theexpired multi-packet data structure, returning the expired multi-packetdata structure to an inactive status.

In other features, the method includes offering two selectable modes.The two selectable modes include a dictionary mode and a plenary mode.The method includes, in the plenary mode, reading a field identifier anda data type from the byte queue, selecting an entry of the messageobject according to the field identifier, copying a number of bytes fromthe byte queue to the selected entry of the message object, andrepeating the reading, selecting, and copying until the byte queue isexhausted. The number is defined by the data type. In other features,the method includes, in the plenary mode, for each selected entry of themessage object, setting a next pointer for the previously selected entryto point to the selected entry. In other features, in the plenary mode,the copying the number of bytes from the byte queue to the selectedentry includes, in response to the data type being a nested message,recursively invoking the reading, the selecting, and the copying on thenested message.

A non-transitory computer-readable medium stores instructions includinginclude reading a token of the message object from the byte queue. Thetoken uniquely identifies a structure of the message object. Theinstructions include obtaining a dictionary definition based on thetoken. The dictionary definition defines a plurality of entries in adefined order including, for each entry of the plurality of entries, adata type and a field identifier. The instructions include iteratingover the dictionary definition in the defined order and, for each entryof the plurality of entries, reading a number of bytes from the bytequeue, selecting an entry of the message object according to the fieldidentifier of the entry, and writing the number of bytes to the selectedentry of the message object. The number is defined by the data type ofthe entry.

In other features, the iterating includes, for each entry of theplurality of entries, writing the data type of the entry to the selectedentry. In other features, the iterating includes, for each entry of theplurality of entries, writing the field identifier of the entry to theselected entry. In other features, the iterating includes, for eachentry of the plurality of entries, setting a flag for the selected entryto indicate valid data is present. In other features, the writing thenumber of bytes to the selected entry of the message object includes, inresponse to the selected entry being a nested message, recursivelyperforming the iterating for entries in the nested message. In otherfeatures, the instructions include storing a plurality of dictionaryentries having a one-to-one relationship with a plurality of tokens.

In other features, the instructions include synchronizing the pluralityof dictionary entries with a dictionary server over the communicationsnetwork. In other features, the instructions include, for user datagramprotocol (UDP) communication, determining whether a received packet isonly part of the message object. The instructions include, in responseto determining that the received packet is only part of the messageobject, copying the received packet to a multi-packet data structure.The instructions include encoding a total number of packets in themulti-packet data structure. The instructions include, in response tothe total number of packets being copied to the multi-packet datastructure, copying each portion of the multi-packet data structure, inpacket order, into the byte queue returning the multi-packet datastructure to an inactive status, and initiating the reading, theobtaining, and the iterating on the byte queue.

In other features, the instructions include, for user datagram protocol(UDP) communication, selectively identifying a moribund multi-packetdata structure that has received no additional packets for a firstthreshold period of time; and, in response to identifying the moribundmulti-packet data structure, sending a retransmit request to atransmission source of the packets in the moribund multi-packet datastructure. In other features, the retransmit request identifies specificpacket numbers missing from the moribund multi-packet data structure.The instructions include, for user datagram protocol (UDP)communication, selectively identifying an expired multi-packet datastructure that has received no additional packets for a second thresholdperiod of time. The second threshold period of time is longer than thefirst threshold period of time. The instructions include, in response toidentifying the expired multi-packet data structure, returning theexpired multi-packet data structure to an inactive status.

In other features, the instructions include offering two selectablemodes. The two selectable modes include a dictionary mode and a plenarymode. The instructions include, in the plenary mode, reading a fieldidentifier and a data type from the byte queue, selecting an entry ofthe message object according to the field identifier, copying a numberof bytes from the byte queue to the selected entry of the messageobject, and repeating the reading, selecting, and copying until the bytequeue is exhausted. The number is defined by the data type. In otherfeatures, the instructions include, in the plenary mode, for eachselected entry of the message object, setting a next pointer for thepreviously selected entry to point to the selected entry. In otherfeatures, in the plenary mode, the copying the number of bytes from thebyte queue to the selected entry includes, in response to the data typebeing a nested message, recursively invoking the reading, the selecting,and the copying on the nested message.

Further areas of applicability of the present disclosure will becomeapparent from the detailed description, the claims, and the drawings.The detailed description and specific examples are intended for purposesof illustration only and are not intended to limit the scope of thedisclosure.

BRIEF DESCRIPTION OF THE DRAWINGS

The present disclosure will become more fully understood from thedetailed description and the accompanying drawings.

FIG. 1 is a functional block diagram of an example environment for amessaging system according to the principles of the present disclosure.

FIG. 2 is a functional block diagram of an example system in whichmultiple communicating applications are located in a single computingdevice.

FIG. 3 is a functional illustration of message exchange in apublish/subscribe system.

FIG. 4 is a functional illustration of point-to-point messagingaccording to the principles of the present disclosure.

FIG. 5 is a functional block diagram of example components of amessaging subsystem according to the principles of the presentdisclosure.

FIG. 6 is a functional block diagram of an example string storage systemaccording to the principles of the present disclosure.

FIG. 7 is a functional block diagram of an example transmission controlprotocol (TCP) implementation of the present disclosure.

FIG. 8 is a functional block diagram of a TCP implementation withclustering of server applications.

FIG. 9 is a graphical illustration of an example data structure formessage objects according to the principles of the present disclosure.

FIG. 10 is a graphical illustration of multiple modes of accessingentries within an example message data structure.

FIG. 11 is a graphical illustration of an example message data structureused for conveying industry-specific data.

FIG. 12 is a graphical illustration of allocation and eventual garbagecollection of objects according to high-level language implementationsin the prior art.

FIG. 13 is a graphical illustration of object recycling according to theprinciples of the present disclosure.

FIG. 14 is a flowchart of example operation of requesting a new objectof an object type that is recycled into pools.

FIG. 15 is a flowchart showing example operation of recycling an objectinto a pool.

FIG. 16A is a graphical illustration of a data structure for adynamically expandable character array with rapid lookup functionality.

FIG. 16B is a graphical illustration of a data structure for adynamically expandable integer array with rapid lookup functionality.

FIG. 16C is a graphical illustration of a data structure for adynamically expandable character array.

FIG. 16D is a graphical illustration of a data structure for adynamically expandable integer array.

FIG. 17 is a flowchart of example operation for resizing a dynamicallyexpandable array structure.

FIG. 18 is a flowchart of example operation of requesting a new arrayaccording to a specified size and data type.

FIG. 19 is a flowchart of example message encoding using a plenaryparser.

FIG. 20 is a flowchart of example message encoding using a dictionaryparser.

FIG. 21 is a flowchart of example array encoding.

FIG. 22 is a flowchart of example operation of transmission of anencoded message.

FIG. 23 is a flowchart of example message reception operation.

FIG. 24 is a flowchart of example operation related to transmissionre-requests.

In the drawings, reference numbers may be reused to identify similarand/or identical elements.

DETAILED DESCRIPTION Introduction

The present disclosure describes a messaging system that can beimplemented with a high-level language and yet achieves performance atthe level of messaging coded with a low-level language. This performancemay be especially important when exchanging time-sensitive data. Thepresent disclosure describes a variety of implementations that allow formessages to be broadcast to multiple receivers with very little overheadbeyond what would be required to transmit a message to a singlereceiver. In this way, time-sensitive data can be distributed to manyusers quickly and reliably.

The structure of the message itself is designed to improve speed as wellas to allow for bifurcation between the messaging infrastructure andbusiness applications. The structure of the message may allow formessaging logic to be tuned for message performance and for businesslogic to be tuned to business demands.

One of the greatest impacts to performance in a high-level language isgarbage collection—that is, returning unneeded memory to the operatingsystem. Without garbage collection, the application would eventually useup all of the available memory and may, depending on factors includingthe design of the operating system, either cause instability of theoperating system, exhaust resources to reducing system performance, orbe terminated by the operating system. In low-level languages, thememory management may be done manually. While this may have betterperformance, it frequently leads to memory leaks, where unneeded memoryis not consistently released, leading to a gradual filling of the memoryby the application.

In order to take advantage of a high-level language but not suffer theperformance penalties of frequent garbage collection, the presentdisclosure describes a new memory management system that allows forobjects and memory to be recycled and reused, thereby avoiding thembeing subject to garbage collection. The memory management system isdescribed below as pooling, where objects having the same or similarstructures are recycled to and retrieved from a pool. To allow formulti-threaded performance, the memory management system can beimplemented as thread-safe so that different threads can recycleobjects.

Specific data structures are defined to overcome the limitations ofvarious built-in data structures of high-level languages. For example,in some languages, the size of an array is fixed. To allow fordynamically sized arrays, the present disclosure describes a datastructure with a dynamic size. The data structure may rely on theunderlying array offered by the high-level language. With dynamicallysized arrays, garbage collection operations are reduced. Similarly, invarious high-level languages, strings are immutable. The presentdisclosure describes a mechanism for employing reusable character orbyte arrays that are mapped to and from strings.

A publish/subscribe architecture that works with both transmissioncontrol protocol (TCP) and user datagram protocol (UDP) is defined forflexibility across network architectures and for different applicationneeds. UDP may be faster for sending each message. UDP handles fan outwith much less processor overhead by using multicast addresses—thenetwork routers then handle fan out, rather than the applications. UDPdoes not have safety guarantees, meaning that lost messages are notre-sent, and messages do not necessarily arrive in order. The presentdisclosure describes various implementations that avoid the risk ofnon-acknowledgment storms, where a vicious circle of packets gettingdropped leads to network congestion from recipients requestingre-sending, thereby increasing the likelihood that additional packetsget dropped. In contrast, various implementations of the presentdisclosure describe specific re-request mechanisms that are triggeredonly when one or more packets of a multi-packet message are missingafter a defined period of time.

The parameters of specific systems may mean that an optimized systemwill use both UDP and TCP. For example, frequently updated data beingdistributed with high throughput and large fan-out may use UDP.Meanwhile, the edges of the system may use TCP. So, as an example, coredata may be distributed to hundreds of streaming servers via UDP. Then,the streaming servers may transmit data to hundreds of thousands ofstreaming clients via TCP.

Messages have to be mapped to byte arrays to be sent over the network(referred to as “externalizing” the message) and, when the byte array isreceived, it needs to be mapped back to a message object. This is a veryprocessor intensive process, and is often the most significantbottleneck in messaging. Externalization of data is usually slower inthe JAVA programming language than in the C programming language,because mathematical operations are extremely fast in the C programminglanguage.

The speed of message externalization may be improved by the structure ofthe message object used by the high performance messaging frameworkaccording to at least some implementations. The structure of the messageobject may reduce or even eliminate the need to perform introspection inorder to determine a state of the message object, and thus, the state ofthe message object may be determined relatively quickly.

The structure of the message object used by the high performancemessaging framework according to at least some implementations mayfacilitate the use of relatively fast, lower-level bitwise operations ofthe high-level language to map fields of the message object onto bytearrays for externalization.

The high performance messaging framework according to at least someimplementations may support “dictionary directed” externalization, whichuses a dictionary shared between a sending device and a receiving deviceto allow some bytes of the message object to be omitted from the datathat is sent from the sender device to the receiver device. This reducesthe amount of system and network resources consumed to transmit the datawhile still allowing the receiver device to correctly parse the receiveddata in order to reconstruct the message object.

Using some or all of the above techniques, the present disclosure allowsfor high-performance message exchange with the deployability,portability, maintainability, and security of a high-level language. Asan example only, the performance offered by an implementation of thepresent disclosure may be able to send 1 million messages per secondusing a single thread. This performance can be sustained, unlike priorsolutions that may only allow for fast bursts of transmission followedby quiescent periods to allow garbage collection to occur.

The high performance messaging framework may achieve one or more of thefollowing goals:

-   1. Increasing or, alternatively, maximizing middleware efficiency so    as to increase the amount of system resources available for other    resource consumers such as business applications.-   2. Decoupling message classes from business objects such that the    business objects can be designed to be straightforward    representations of application information without regard to a    particular manner in which the high performance messaging framework    transmits messages encapsulating the business objects.-   3. Making the message classes independent from a particular    transport mechanism being used such that different transport    mechanisms may be swapped out with minimal disruption to the    operation of the application that is using the high performance    messaging framework. For example, a TCP socket implementation may be    exchanged for a vendor's JAVA message system (JMS) solution    orthogonally to the rest of the code.

The C programming language allows for explicit allocation anddeallocation of memory from the memory heap with respect to dataobjects. In the JAVA programming language, allocation of memory from thememory heap is handled automatically and deallocation is handledautomatically through the use of system-resource-heavy garbagecollection operations. In contrast, the high performance messagingframework in various implementations may use a plurality of object poolscorresponding, respectively, to a plurality of different object types inorder to implement a recycling operation that explicitly places apoolable object, which is no longer in use by an application, into anobject pool corresponding to the object type of the poolable object.

The poolable therefore object does not trigger a resource-heavy garbagecollection operation. The poolable object, for which data has alreadybeen allocated from the memory heap, is available to be retrieved fromthe object pool in lieu of allocating more memory from the memory heapfor a new object when the application needs a new object having a sameobject type as the poolable object. Further, the poolable object mayalready have a complicated (and sometimes nested one or more layersdeep) structure that does not have to be constructed from scratch.

Illustrations

FIG. 1 shows computing devices 100-1 and 100-2 communicating with eachother and/or with servers 104-1 and 104-2 via a communications network108. The computing devices 100-1 and 100-2 may be user devices and/orservers themselves. The computing device 100-1 includes a functionalblock of processor and memory 112-1, which communicates with thecommunications network 108 via a network interface 116-1. In variousimplementations, functionality of the network interface 116-1 may beintegrated into the processor and memory 112-1.

The processor and memory 112-1 implements an operating system networkingstack 120-1 and a first application 124-1. The first application 124-1is integrated with or invokes a messaging subsystem 140-1 according tothe principles of the present disclosure. The first application 124-1includes business logic 144-1, which generally represents thefunctionality of the first application 124-1 other than messaging.

The computing device 100-2 also includes a network interface 116-2 and afunctional block of processor and memory 112-2, which implements anoperating system networking stack 120-2 and a second application 124-2.The second application 124-2 includes business logic 144-2, which may bethe same as or different than the business logic 144-1. In variousimplementations, the second application 124-2 may be a secondinstantiation of the first application 124-1, while in otherimplementations the second application 124-2 has a different purpose andimplements different business logic. The second application 124-2 alsoincludes a messaging subsystem 140-2, which may be a copy of themessaging subsystem 140-1. While shown within the first application124-1, the messaging subsystem 140-1 may be external to the firstapplication 24-1: for example, implemented as a shared library oroperating system service.

The communications network 108 includes a distributed communicationssystem such as the Internet. The computing device 100-1 may be apersonal computer running an operating system such as the Linuxoperating system from Linus Torvalds, the MacOS operating system fromApple Inc., or the Windows operating system from Microsoft Corp. Thecomputing device 100-1 may be a portable device, such as a laptop,mobile phone, etc. The computing device 100-1 may be a wearable devicesuch as a smartwatch. The computing device 100-1 may be a smarttelevision, a set-top box, or a streaming device with video being outputto a separate display. The computing device 100-1 may be a device thathas no visual display, such as a smart speaker or other virtualassistant device.

Although the simplified block diagram of FIG. 1 shows all devicesconnected directly to the communications network 108, one or morenetwork devices may facilitate communication between the displayeddevices, some of or all of which communication may bypass thecommunications network 108 entirely. For example, the servers 104-1 and104-2 may sit behind a common web firewall architecture. As anotherexample, the computing device 100-1 may connect through a home routerbefore connecting to infrastructure of the communications network 108.

In FIG. 2 , another configuration is shown where a computing device100-3 includes multiple applications. The computing device 100-3includes a network interface 116-3 and a functional block of processorand memory 112-3. The processor and memory 112-3 implement an operatingsystem networking stack 120-3, the first application 124-1, and thesecond application 124-2. In various implementations, the configurationis left to deployment engineers, such that some computing devices mayhave a single application while others will have multiple applications,each using a messaging subsystem. In various implementations, the firstapplication 124-1 and the second application 124-2 may share a commoncopy of a messaging subsystem, implemented as a shared library,operating system service, etc.

In FIG. 3 , four circles graphically represent application A 200-1,application B 200-2, application C 200-3, and application D 200-4. Alarge rectangle represents topic i 204, where the letter i refers to atopic identifier in a publish/subscribe (pub/sub) system. For example,the topic identifier may be an integer, such as a 32-bit unsignedinteger. In the particular example shown, applications A and B 200-1 and200-2 have been configured to publish to topic i 204. Similarly,applications C and D 200-3 and 200-4 have registered as subscribers totopic i 204.

The roles of the applications 200 may be different depending on thetopic. For example, one of the applications 200 may be a publisher toone topic but a subscriber to another topic. In many situations, anapplication will subscribe only to some topics; similarly, anapplication will generally only publish to a subset of the availabletopics.

When application A 200-1 publishes a first message 208-1, the firstmessage 208-1 is sent to the entities that have subscribed to topic i204—in this example, application C 200-3 and application D 200-4.Application C 200-3 and application D 200-4 are shown receiving thefirst messages 208-2 and 208-3. In various implementations, the firstmessages 208-2 and 208-3 may not be additional copies of the firstmessage 208-1 but instead a single message sent to a multicast addressspecific to topic i 204. The multicast address may be specific to topici 212-1. However, there may be more topics than multicast addresses—insituations where that is true or possible, a combination of multicastaddress and port number may be used to uniquely correspond to a topic.In other implementations, a relay may receive the first message 208-1and transmit the first message 208-2 and the first message 208-3 to thesubscribers.

Subsequently, application B 200-2 is depicted publishing a secondmessage 212-1 to topic i 204, which is distributed to the correspondingsubscribers. This distribution is graphically represented as secondmessages 212-2 and 212-3.

Once application C 200-3 has received the first message 208-2,application C 200-3 may be able to send a first reply 216 to applicationA 200-1. In various implementations, the ability to send a reply iscontingent on the publication of the first message 208-1 including replydetails. For example, when application A 200-1 publishes the firstmessage 208-1, the publication may include callback information tocontact application A 200-1. The callback information may include arequest ID to be used in any replies. Once application A 200-1 receivesthe first reply 216, application A 200-1 may be able to respond with yetanother reply, second reply 220. In various implementations, the abilityto transmit the second reply 220 may be contingent on the first reply216 including callback information for contacting application C 200-3.In other implementations, transmission of the first reply 216 mayinherently include (such as in the packet header) the information neededto contact application C 200-3.

In FIG. 4 , a graphical illustration of point-to-point (PTP) messagingis shown. In this particular example, application E 200-5 sends a thirdmessage 224 to application F 200-6. Application E 200-5 may havediscovered the contact mechanism for application F 200-6 as a result ofa subscription message being received or by consulting a directory. Forexample, the directory may identify contact information for applicationscorresponding to various services. As one example, application F 200-6may be present in a directory as offering a real-time stock quotationservice.

In response to the third message 224, application F 200-6 may transmit afourth message 228 back to application E 200-5. Application E 200-5 maythen transmit a fifth message 232 to application F 200-6. There may beno limit to the number of messages that can be exchanged and, in variousimplementations, there is no restriction specifying that messagesexchanged between two applications have to alternate direction frommessage to message. In other words, application F 200-6 could transmitmultiple messages to application E 200-5 without application E 205having responded with a message. A messaging system according to theprinciples of the present disclosure may implement one or both ofpub/sub and PTP architectures.

Interfaces

An example publisher interface may be defined as follows:

start ( ) publish(String topic, Message msg) publish(String topic,Message msg, int reqID, Requestcallback callback) send(EndPointRoute to,Message msg) send(EndPointRoute to, Message msg, int reqID,Requestcallback callback closeRequest(int reqID) stop( )

Because the publisher interface is an interface, the methods of thepublisher interface are abstract methods. Any class used in anapplication can include the variables and methods of the publisherinterface by implementing the publisher interface. The publisherinterface may include a start method, which may be invoked to createresources involved in performing a publishing operation, and a stopmethod, which may be invoked to clean up the created resources. Thepublisher interface may also include first and second publishing methodsand first and second PTP methods.

Each of the first and second publishing methods and may be used topublish a message (msg) to a topic (topic), which maps to informationfor how to route the message (msg) to subscribers. For example, thetopic may be an integer or a string. In various implementations, thesecond publishing method differs from the first publishing method inthat the second publishing method includes two additionalarguments—request ID (reqID) and request callback (callback) which canbe used by a publisher to request a response to the message (msg) from arecipient of the message (msg), such as a subscriber to the topic(topic). In various implementations, the request ID (reqID) of thesecond publishing method may be used to identify an individual requestfor a reply made by the publisher and the request callback (callback)may be any object that implements the RequestCallback interface.

Each of the first and second PTP methods may be used to send a message(msg) to a recipient. In various implementations, the EndPointRoute (to)is included as an argument in the first and second PTP methods and maybe an object that identifies an object or address that can be used toroute the message (msg) to the recipient.

The second PTP method differs from the first PTP method in that thesecond PTP method includes the same two additional arguments that werediscussed above with respect to the second publishing method: request ID(reqID) and request callback (callback). Similar to the request ID(reqID) and request callback (callback) of the second publishing method,the request ID (reqID) and request callback (callback) of the second PTPmethod can be used by a sender of the message (msg) to request a replyto the message (msg) from a recipient of the message (msg). The requestID (reqID) of the second PTP method may be used to identify anindividual request for a reply made by the publisher, and the requestcallback (callback) of the second PTP method may be any object thatimplements the RequestCallback interface.

In various implementations, the publisher interface may also include aclose request method for closing a reply request that corresponds to therequest ID (reqID) so as to stop receiving replies to the reply requestthat corresponds to the request ID (reqID).

An example subscriber interface may be defined as follows:

  start ( ) subscribe(String topic, Subscriptioncallback callback)unsubscribe(String topic, Subscriptioncallback callback stop( )

Because the subscriber interface is an interface, the methods of thesubscriber interface are abstract methods. Further, any class used in anapplication can include the variables and methods of the subscriberinterface by implementing the subscriber interface. The subscriberinterface may include a start method, which may be invoked to createresources involved in performing subscribing operations, and a stopmethod, which may be invoked to clean up the created resources. Thesubscriber interface may also include subscribe and unsubscribe methodsfor subscribing to, or unsubscribing from, a topic. The subscribe andunsubscribe methods each have, as arguments, a topic and a callback. Thecallback may be an object of any class that implements theSubscriptionCallback interface.

A request callback interface may be defined as:

receive(int regID, Message msg, EndPoint responseRoute)

A subscription callback interface may be defined as:

receive(String topic, Message msg, EndPoint responseRoute)

The RequestCallback interface and the SubscriptionCallback interfaceeach includes a receive method. In various implementations, any time amessage is published to a topic using the first publishing method, thereceive method of subscribers to the topic is invoked with the message(msg) and topic (topic) of the receive method being the same as themessage that was published and the topic to which the message waspublished, and the endpoint (responseRoute) of the receive method is setto a null value.

In various implementations, any time a message is published to a topicusing the second publishing method, the receive method of subscribers tothe topic is invoked with the message (msg) and topic (topic) of thereceive method being the same as the message that was published and thetopic to which the message was published. However, the endpoint(responseRoute) of the receive method is not equal to null. Instead, theendpoint (responseRoute) of the receive method will contain informationthat will allow subscribers to send replies to the publisher thatpublished the message using the second publishing method.

In various implementations, after a subscriber replies to a publisherthat published a message using the second publishing method, the receivemethod of the RequestCallback interface may be invoked by the publisherwith the request ID (reqID) of the receive method equal to the requestID (reqID) included in the second publishing method which was previouslyused by the publisher, and the message (msg) of the receive method ofthe RequestCallback interface equal to the reply sent to the publisherby the replying subscriber.

If the replying subscriber used the first PTP method of the publisherinterface to send the reply to the publisher, then the endpoint(responseRoute) of the receive method of the RequestCallback interfacewill be set to null. Alternatively, if the replying subscriber used thesecond PTP method of the publisher interface to send the reply to thepublisher, then the endpoint (responseRoute) of the receive method ofthe RequestCallback interface will not be null. Instead, the endpoint(responseRoute) of the receive method of the RequestCallback interfacewill contain information that will allow the publisher to reply to thereplying subscriber (e.g., using the first PTP method or the second PTPmethod of the publisher interface).

Block Diagram

In FIG. 5 , an example implementation of the messaging subsystem 140-1is shown to include a transmit module 304 that transmits messages, whichmay be in packetized form, to the operating system networking stack120-1. For example, the transmit module 304 may receive an encodedmessage from an encoding module 308 and output the encoded message asone or more packets, frames, or datagrams. The transmit module 304 mayalso keep track of identifying information for recipients of messages,such as Internet protocol (IP) address, multicast address, port, requestID, etc.

A subscription management module 312 communicates via the operatingsystem networking stack 120-1 with a topic subscription server and/or adirectory server. In various implementations, the functionality of oneor more of the servers may be co-located and/or distributed. Forexample, a peer-to-peer system may allow for replicas of a servicedirectory or subscription list to be replicated across multiple modes.In various implementations, the subscription management module 312manages a node and stores data locally.

In various implementations, the subscription management module 312subscribes and/or unsubscribes from specific topics as dictated by thebusiness logic 144-1. The subscription management module 312 may alsomaintain a service directory to identify a recipient able to serviceparticular requests. For example, one request may be for real-timefinancial data. In various implementations, multiple servers (or othercomputing devices) may offer real-time quotations for publicly tradedequities. In various implementations, the servers may each beresponsible for only a subset of the publicly traded equities. In asimplistic example, one server may be responsible for financial dataabout equities whose ticker symbol begins with a letter between A and Mwhile a second server is responsible for providing information forequities whose ticker symbol beings with a letter between N and Z.

in various implementations, dictionary synchronization and managementmay be handled by a dictionary management module 316. The dictionarymanagement module 316 may obtain dictionary definitions of messageshaving relevance to the business logic 144-1. In variousimplementations, certain definitions may be relevant to certain topicsand therefore those dictionary definitions may be obtained by thesubscription management module 312 according to the set of subscribedtopics. Dictionary definitions are described in more detail below, butin brief are definitions of the structure of messages, specifyingidentities and data types of fields in the messages.

The dictionary management module 316 may operate in a client-serverrelationship and may request dictionary definitions from a dictionaryserver. In various implementations, the dictionary management module 316may maintain a complete set of dictionary definitions and mayperiodically obtain updates from the dictionary server. In various otherimplementations, the dictionary management module 316 may instead obtaindefinitions that are needed for either sending or receiving messages bythe messaging subsystem 140-1. In this way, storage space for unneededdictionary definitions can be saved. In various implementations, changesto dictionary definitions may be pushed to the dictionary managementmodule 316 in addition to or alternatively to periodic update pulls bythe dictionary management module 316.

As described in more detail below, the encoding module 308 may use adictionary definition from the dictionary management module 316 toencode a message into a byte stream for transmission. Similarly, adecoding module 320 may use a dictionary definition from the dictionarymanagement module 316 when a receive module 324 provides a stream ofbytes that have been encoded using that dictionary definition.

When the business logic 144-1 decides to send a message, the businesslogic 144-1 provides the message to a message input module 328. Messageinput module 328 requests a message object from an object storage module332 and, as described in more detail below, configures the messageobject appropriately to store the message from the business logic 144-1.Once the message is stored, the encoding module 308 encodes the messageand passes the encoded byte stream to the transmit module 304. Theencoding module 308 can then release the message object back to theobject storage module 332 for reuse.

In various implementations, as part of storing data from the businesslogic 144-1 into a message object, the message input module 328 may relyon a string store module 336, which maps strings to arrays and viceversa. For example, if the business logic 144-1 provides a string suchas “IBM”, the string store module 336 may have a byte array or characterarray with elements representing the letters I, B, and M in that order.A reference to this array can be used every time the string IBM isreferenced, rather than creating a new literal IBM string every time amessage requires that string.

In the other direction, a message output module 340 provides a receivedmessage to the business logic 144-1. The decoding module 320 requests amessage object from the object storage module 332 and populates themessage object based on the byte stream obtained from the receive module324. The decoded message object is provided to the message output module340, which transfers the message object to the business logic 144-1. Ifany fields of the message are strings, the message output module 340 mayuse the string store module 336 to map a byte or character array fromthe decoding module 320 into a string literal for provision to thebusiness logic 144-1.

As described in more detail below, the object storage module 332 may usea pooled approach to memory management where similar objects are pooledtogether. For example, each type of message may have a unique messagetoken. Message objects having the same message token have the samestructure (the set of fields in the message object) and may be pooledfor reuse.

Similarly, arrays of a certain type may be pooled by the object storagemodule 332. In various implementations, multiple pools for each datatype may be present. For example, arrays of integers may be pooledseparately based on their length. For example, there may be a pool forinteger arrays with a backing array of length 16, a pool for integerarrays with a backing array of length 32, etc. When populating a messageobject with different sizes of array elements, these pooled arrays canbe obtained from the object storage module 332. The object storagemodule 332 therefore operates almost as a memory manager in place of thebuilt-in memory management and garbage collection afforded by thehigh-level language and its environment, such as a Java virtual machine(JVM).

FIG. 6 is an example implementation of the string store module 336.While the present disclosure describes strings (also known as literalsor literal arrays) as examples, the following solutions for caching andlookup of immutable objects can be used for other forms of immutableobjects. As with strings, other forms of immutable object may requirenew memory allocation (and eventual garbage collection) every time a newimmutable object is used. The following teachings describe how toimprove performance—and, in some environments, memory efficiency—forsituations where equivalent immutable objects may be repeatedly used.

In the present disclosure, strings may be represented by ByteArrays orCharArrays. Both ByteArray and CharArray may have getString( ) andsetString(str) methods for conversion between the array classes andstrings. The Message class also exposes the getString(token) andsetString(token, str) methods. Instead of, for example,message.getByteArray(fid).getString( ), the caller can more directlyinvoke message.getString(fid).

Strings—including those implemented in the JAVA programming language—cancause some problems for high-performance applications because stringsare immutable. As a result, usage of strings may create garbage andforce garbage collection, which decreases performance. For example,every time that the string “IBM” is used, a new string object may haveto be allocated from the heap and then, when the message using thatstring object is sent, scheduled for garbage collection. In brief, thestring store module 336 allows every message referencing the string“IBM” to reference a single instance of the object.

For applications that wish to avoid garbage collection, the presentdisclosure defines a StringStore class, which maps string onto theirencodes, and encodes to strings. The ByteArray & CharArray classes havemethods that use StringStores: the retrieveString( ) andputString(string) methods. The putString(fid, string) andretrieveString(fid) methods are also exposed directly on the Messageclass. The retrieveString( ) method is generally more performant thatgetString( ), and does not create garbage. The setString( ) method, onthe other hand, is generally more performant that putString( );putString( ) is generally only of value for pre-populating theStringStore.

In the example of FIG. 6 , the string store module 336 includes a firstmapping module 404. The first mapping module 404 stores a set of bytearrays and, when a string is received, determines whether any existingarrays are equivalent to the string. If not, the string indexed by thefirst mapping module 404 may return an error message and/or may create anew byte array corresponding to the string.

Methods for generating byte arrays from strings may already exist in thehigh-level language. For example, in the JAVA programming language, amethod like getBytes( ) may be used. However, these methods have higherlatency and will require the generation of new byte arrays—that is,allocating memory from the heap to generate new byte arrays—which mayultimately result in unwanted garbage collection operations, and thus,reduced speed and/or less efficient use of processing resources. Incontrast, the first mapping module 404 allows a byte array correspondingto a particular string to be obtained without the need to create a newbyte array.

The first mapping module 404 may record times associated with each bytearray indicating when the byte array was last referenced. To reducememory footprint, the first mapping module 404 may discard byte arraysthat have not been used for longer than a predefined time period. Inother implementations, the first mapping module 404 may only evictarrays from storage when a total size of the first mapping module 404reaches a limit. Then, the first mapping module 404 may evict the leastrecently used arrays first.

In other implementations, the first mapping module 404 may maintain acount of how often an array has been used and evict the least usedarrays. To prevent arrays that were previously frequently used and areno longer being used from crowding out new arrays, the accounts may bedecremented over time, such as with the next exponential decay appliedto accounts at periodic intervals.

A second mapping module 408 is string-indexed and returns characterarrays. The second mapping module 408 may operate similarly to the firstmapping module 404 except that a set of character arrays correspondingto strings is stored in the second mapping module 408. In variousimplementations, the first and second mapping modules 404 and 408 may berelied on by the message input module 328 to convert strings frombusiness logic into arrays for use with a message data structureaccording to the principles of the present disclosure.

In various implementations, the arrays referenced here may be nativearrays provided by the high-level language. In other implementations,the arrays may be custom arrays, such as a special array class, thathave additional features. For example, as described in more detailbelow, the custom arrays may be able to be resized, contrary to nativearrays in many high-level languages, which are fixed in size.

A third mapping module 412 is indexed by a byte array and returns astring. In various implementations, the third mapping module 412 storesa set of strings and a set of hashes corresponding to the strings. Thehash function is applied to the incoming byte array and then that hashis compared to the set of hashes. For example, a hash map, which may beoffered by the high-level language, may be used for this purpose. Once ahash is found in the hash map, the byte array is compared—for example,byte by byte—to the string to ensure a match. If a match is found, thestring literal is returned. If a match is not found, a new stringliteral may be created and returned.

A fourth mapping module 416 may be implemented similarly to the thirdmapping module 412 but, instead of receiving a byte array as an index,the fourth mapping module 416 receives a character array as an index.The fourth mapping module 416 then returns a string literal matching thereceived character array. In various locations, the message outputmodule 340 of FIG. 5 may use the third and fourth mapping modules 412and 416 to output strings to business logic.

In FIG. 7 , a graphical representation of transmission control protocol(TCP) client-server architecture is depicted. A set of clients 504-1,504-2, 504-3, 504-4, 504-5, 504-6, and 504-7 consult a server registry508 to determine which servers to communicate with. In FIG. 7 , depictedare a first proxy range 512-1, a second proxy range 512-2, a third proxyrange 512-3, and a fourth proxy range 512-4.

In various implementations, all of the clients 504 and the servers 512in the proxy ranges connect to the server registry 508. The servers 512send information about their transports, and how to connect to them. Theclients 504 request information about current servers on a transport. Ifserver information changes, the server registry 508 pushes the change tothe clients 504. The clients 504 will connect to one server in everycluster that serves the transport. If servers are unclustered, theclients 504 connect to every server that serves the transport. Theservers 512 can be stand-alone servers or hosted by another service. Theserver registry 508 may have a backup instance running that can befailed over to in the event that the server registry 508 suffers afailure.

For TCP, all nodes in a transport are assigned to be either a client orserver. In general, any publisher would be a server, and any subscriberwould be a client. However, each node may be a publisher to some topicsand a subscriber to other topics. The present disclosure permits serversto subscribe to a topic and clients to publish to the topic.

Therefore, assigning nodes to either a client role or a server roleoffers a host of advantages in performance and simplicity. This meansthat client nodes can't talk directly with other clients and servernodes can't talk directly to other servers. However, the impact to themessaging architecture is minimal. In various implementations, clientssubscribe to all servers on a transport immediately, rather than doingtopic by topic discovery.

In various implementations, when a node subscribes to a topic, thattopic is sent on every connection for that transport; and when a nodeunsubscribes, it sends an unsubscribe alert on every connection. Invarious implementations, every node maintains the list of topicssubscribed on every connection. A transport is configured with itspublisher type.

When a node publishes to a topic, it checks every connection in thetransport and sends to every remote node for which it has asubscription. To help with handling fan-out and/or slow consumers, threetypes of publishers may be defined: serial, parallel, and threadPool.The serial type sends to all remote nodes on the current thread. Theparallel type assigns each remote node its own thread, which handles thepublishing to that node. The threadPool type defines a pool of threadsfrom which messages are published.

For PTP communication, the present disclosure sends to an “endPoint.”For TCP, the endPoint contains the SocketChannel of the node the messagewill be sent to.

When a client loses connection to a server, it will try to reconnect,with a step-back. If the server is down, the server registry 508 willalso lose connection. When the server registry 508 loses connection, itwill tell clients that the server is no longer available for thetransport. At that point, the client will stop trying to reconnect.

When a server is added, or brought back up, it connects to the serverregistry 508. The server registry 508 tells clients that there is a newserver. The clients connect to the server, and send their subscriptionlists. When a client subscribes to a server, the server will send theclient its subscription list

Both blocking & non-blocking types of TCP are supported. The transportis configured with the type to use. To improve throughput, ranges may beestablished—for example, with each server only responsible for a rangeof requests that is a subset of a total set of requests. As one example,the total set of requests may include data of ticker symbols, and eachrange may be a subset of ticker symbols, segmented for example by thefirst letter of the ticker symbols. To improve performance with fan-out,clustering can be used.

In FIG. 8 , a set of TCP servers implementing clustering is depicted. Afirst computer 520 includes a first application 524-1, a secondapplication 524-2, a third application 524-3, and a fourth application524-4. Another computer 528 includes copies of the applications runningon the computer 520. For clarity, these are labeled as applications 532.Similarly, another computer 536 includes a copy of the applications,this time labeled as applications 540. The multiple copies of theapplications spread across the computers 520, 528, and 536 allow forload balancing, which is especially helpful for high-fan-out situations.For example, the client 504-7 may communicate with the applications 532in the computer 528, while the client 504-4 may communicate with theapplications 524 and the computer 520. The load balancing may becontrolled by the server registry 508 or by another mechanism.

As one example among many, the messaging architecture of the presentdisclosure may be used for exchanging financial information at highspeed. For example, the client 504-4 may include an application referredto as an order management system, which executes buy and sell ordersfrom customers. The order management system may obtain quotes fortradable equities from the applications 524. Continuing the example, theapplications 524 may operate as quote servers, with the firstapplication 524-1 servicing requests for symbols beginning with theletters A-E, the second application 524-2 servicing requests for symbolsbeginning with the letters F-M, the third application 524-3 servicingrequests for symbols beginning with the letters N-S, and the fourthapplication 524-4 servicing requests for symbols beginning with theletters T-Z.

Unlike UDP, TCP can be clustered on the transport level. Whenapplications serve data over TCP, they will generally be clustered onthe transport level not on the application level (that is, allapplications in the cluster will be active). Servers may be configuredwith a cluster name(s) for its transport(s). If a server does not have acluster name, the cluster name be set equal to the socketAddr (socketaddress) to ensure it is unclustered.

When the client subscribes to the server registry 508 for its firsttransport, it receives a clientNum unique to the client. Any time theclient subscribes for a transport, it receives back server cluster namesfor that transport and a list of socket addresses for each cluster. Forexample, the client connects to: addrList.get(clientNum % addrList.size()).

If a client loses connection, then as before, it will try to reconnectuntil it (i) connects, (ii) reaches a maximum number of retries, or(iii) gets a new address list from the server registry 508. If itreaches the maximum number of retries, the client will try the nextentry in its addr list.

If the server is down, it will disconnect from the server registry 508.The server registry 508 will remove the server from the cluster list andpublish the new addr list. If a client is not connected (due to a lostserver), the client will connect using the new list. If a client isconnected, it will connect according to the new list if a configurableflag is set (for example, the flag may be named autoRebalance).

When a server comes up, it connects to the server registry 508 and sendsits connection info. The server registry 508 updates its cluster listand sends the updated information to clients. A client will reconnectusing the new list if the autoRebalance flag is set.

Auto-rebalance is beneficial because keeps the load balanced but has thedownside of interrupting otherwise stable connections. As a result, theautoRebalance flag is configurable according to the needs of thedeployment. For example, the autoRebalance flag may be cleared(equivalently, set to false) when the cluster is large or clients do notconnect for long periods of time.

Conversely, the autoRebalance flag may be set (equivalently, set totrue) when the cluster is small and clients remain connected for longperiods of time. The autoRebalance flag may be set by default. Invarious implementations, the autoRebalance flag is cleared and forcedrebalances are scheduled periodically. The periodic schedule may beadaptive according to traffic—for example, a scheduled rebalance may bedelayed by up to 12 hours if a level of activity is above a threshold.The threshold may be adaptive—for example, the threshold may be set as apercentage (such as 20%) of an average of daily peak activity metrics.Note that a forced rebalance may not result in any disconnections if thecurrent server list is unchanged from the last rebalance.

Message Structure

In FIG. 9 , a graphical illustration of a message data structureaccording to the principles of the present disclosure is shown. Amessage object 600 includes, in this example, a token 604, a pool ID608, a next message pointer 612, a first active pointer 616, and anarray of entries 620. The token indicates the type of message and may bean integer. For example, a specific token may indicate that the messageincludes a character array, a floating point number, and an integer. Asone example, this may be a stock quote message, where the characterarray indicates the ticker symbol, the floating point number indicates acurrent price, and the integer indicates number of trades in the lasthour. A message having this token will therefore always have these threepieces of data.

The pool ID 608 indicates which pool that the message object 600 belongsto. The pool ID 608 is used to select a pool to return the messageobject 600 to once the message is not needed—generally, when the messageobject 600 has been delivered to the business logic or transmitted tothe communications network. The pool may be implemented as a linked listand therefore, when the message object 600 is in the pool, the nextmessage pointer 612 points to the next message in the pool. When themessage object 600 is in use, the next message pointer 612 may be nullor may be undefined.

As described in more detail below, the first active pointer 616 allowsfor iterating through a linked list of the entries in the message object600. The array of entries 620 includes an array of entry objects, asexplained in more detail below. In various implementations, the array ofentries 620 may be a sparse array in that not every element of the arraycontains a valid field. The reason for this is to allow rapid access tospecific entries of the message object 600 without having to indexthrough the entire array. The terms “field” and “entry” may be usedinterchangeably, though for clarity: every element of the entry array isan “entry,” while “field” refers to those entries that are active andhave data values.

An example entry 640 includes a field ID 644, a data type 648, a Booleanactive flag 652 (also referred to as an active indicator), a next activepointer 656, and a data value 660. Using the above example, the datavalue 660 of one entry may be a stock ticker symbol, the data value 660of another entry may be a floating point price, and the data value 660of another entry may be an integer volume of trading. The field ID 644may be an integer and indicates the identity of the field. For example,a specific field ID may indicate that the field is a stock ticker symbolas compared to a customer name.

The data type 648 identifies the type of the data in the data value 660.A list of example field types is shown at 680 and includes a set ofprimitive types, which may be defined by the high-level language, aswell as additional types. In this example, the primitive types includeBoolean, byte, character, short, int, long, float, and double. The otherfield types are a message and an array. In various implementations, amessage class may define an enumeration (for example, a typecorresponding to the keyword enum in the JAVA programming language)called Type for use with the data type 648, which encapsulates theBoolean, byte, char, short, int, long, float, double, message and arraydata types as fixed constants.

Allowing the entry to be of type message means that the message datastructure can be nested. For example, a first message token maycorrespond to a message that describes a customer—the fields may includefirst name, last name, and customer ID. A second message token maycorrespond to a message with a field for an account balance and anotherfield describing the customer corresponding to the account balance. Thatfield may be a message having the same structure as the first messagetoken to specify the customer data.

A field type of array allows for multiple elements. These items may be,in various implementations, of any type, including the field types shownat 680. In other words, an entry may have a type that is an array ofmessages or an array of Boolean values. An array of characters or bytesmay be used to store text data, functionally similar to a string.

The active flag 652 indicates whether the entry 640 includes a value ornot. The active flag 652 may be cleared (equivalently, set to false)until the field is populated, such as from data provided by the businesslogic. Entries in the array of entries 620 that do not contain fieldsrelevant to the current message may have an active flag 652 set to zero.In various implementations, a majority of the entries in the array ofentries 620 may have the active flag 652 cleared.

To avoid having to iterate through the array of entries 620 looking forentries with set active flags, a linked list of active entries isformed. The first active pointer 616 of the message object 600 (alsoreferred to as a head pointer since it points to the head of a linkedlist) points to a first active entry of the array of entries 620. Thenext active pointer 656 of an active entry points to the next activeentry in the array of entries 620. The next active pointer 656 of thefinal active entry in the array of entries 620 may be set to null.

In FIG. 10 , example access mechanisms for the message structure shownin FIG. 9 are illustrated graphically. The first active pointer 616points to a first entry 640-1, which has a next active pointer 656-1pointing to another entry 640-2. The entry 640-2 has a next activepointer 656-2 that points to the next active entry. Finally, a nextactive pointer 656-k points to a final entry 640-k+1. Not shown is thenext active pointer 656-k+1 of the last entry, which may be set to null.

In order to iterate through all of the entries in the linked list,control begins with the first active pointer 616. This linked listiteration may be useful for reading out all of the active entries, suchas when encoding a message into a byte queue. However, if a particularentry needs to be read, the linked list may be inefficient, especiallyfor entries not near the beginning of the list.

Therefore, a direct access mechanism is defined for some implementationsof the message structure. The array of entries 620 is defined to have alength of N. Each field is placed in the array of entries 620 accordingto its field ID. In various implementations, the field ID may be useddirectly to determine the index into the array for the field.

In various implementations, a hash can be calculated from the field IDto determine an index of the array for the field. In variousimplementations, a simple modulo N (mod N) operator 624 is used as thehash. The operator 624 is represented as a rectangular block in FIG. 10. In various implementations of the modulo N operator, the field ID maybe directly used as the “hash” if the field ID is less than or equal toN; only if the field ID is greater than N must a calculation beperformed.

If there are two active fields (which, by definition, have differentfield IDs) where the hash function results in the same index for thedifferent field IDs, this is a collision. In such a case, the array ofentries 620 is expanded by increasing the size of N, such as bydoubling. This increasing is performed until there are nocollisions—that is, the hash function generates a unique index for eachfield ID.

Accordingly, this approach may result in many inactive entries in thearray of entries 620 while allowing for rapid direct access to eachactive field. In the implementation shown in FIGS. 9 and 10 , very rapiddirect access to each individual entry (which may be relevant to plenaryparsing) is combined with iterative access to the entire set of entries(which may be relevant to dictionary parsing). This unique combinationprovides tremendous performance and computational efficiency advantages.

In FIG. 11 , an example field array 700 is shown for an example messageparticular to a specific industry. In this example, the field array 700is used for a message that carries information about an option chain. Afirst field 704 is a character array containing the name of the securityfor which the option chain is constructed. The second field 708 is afloating point number indicating a closing price of the security. Athird field 712 is a floating point number indicating a last price ofthe security. A fourth field 716 is an array of messages, one for eachoption in the option chain.

Note that the fields 704, 708, 712, and 716 may appear in a differentorder in the array of entries and may be spaced out across the array ofentries depending on their field IDs, which are not shown. If themessage of FIG. 11 were the only message of interest, the field IDs forthese fields could be chosen as 1, 2, 3, and 4, leading to a verycompact array of entries. However, because the messaging architecture isrelevant to a wide array of messages, field IDs within the message willfrequently be nonconsecutive.

The fourth field 716 includes multiple array entries of type message,including a first message 720-1, a second message 720-2, . . .(collectively, message 720). The messages 720 are all the same type ofmessage and therefore have a token value of m. Because they all have thesame token, only the first message 720-1 is illustrated. In thisexample, the first message 720-1 includes a character array field 724-1that indicates the name of the contract, a floating point entry 724-2that indicates a bid price, a floating point entry 724-3 that indicatesan asking price, a floating point field 724-4 that indicates a strikeprice, a long (long integer) field 724-5 that indicates a last tradedate, and a long field 724-6 that indicates a trading volume.

An example message class may be defined to include the followingcomponents and methods:

  getToken ( ) getBoolean (int fieldId) ; setBoolean (int fieldId,boolean value); getByte(int fieldId); setByteint fieldId, byte value); .. . getArray(int fieldId) returnArray (int fieldId, Type arrayTypegetMessage(int fieldId) returnMessage (int fieldId) Entry[ ] entries =new Entry[32] Entry firstActive clear( )

The entry objects may be defined by an Entry class included in themessage class, such as the following:

  private class Entry {   public final int fieldId;   public final Typetype;   public boolean hasValue;   public Entry nextActive; }

According to at least some example embodiments, typed subclasses of theEntry class (i.e., classes that extend the Entry class) are used tostore data values (i.e., the data value held by the message fieldcorresponding to the entry). The data value held by the message fieldcorresponding to the entry may also be referred to as message data.Examples of two typed Entry subclasses, BooleanEntry and ByteEntry, areshown here:

  private class BooleanEntry extends Entry {   public boolean value; }private class ByteEntry extends Entry {   public byte value; }

For the purpose of simplicity, examples of typed Entry subclasses areshown for only two types of data values: boolean and byte. However,according to at least some example embodiments, the message class mayinclude typed Entry subclasses for each of a plurality of types of datavalues (e.g., JAVA primitives: boolean, byte, char, short, int, long,float, and double, as well as message objects and array objects).

The message class includes a getToken method that returns value (such asin integer) that identifies a message type, from among a plurality ofdifferent message types, of a message object. The message class furtherincludes primitive field get and set methods which may include get andset methods for each one of a plurality of primitives (for example, theJAVA programming language primitives: Boolean, byte, char, short, int,long, float, and double). The set methods among the primitive field getand set methods are used to set the value (value) of a field (that is,an active entry) having the field ID (fieldId). The get methods amongget and set methods are used to obtain the value of a field (that is, anactive entry) having the field ID (fieldId).

The message class further includes object field get and return methods.In contrast with the primitive fields, the object fields have the returnmethod instead of the set method in various implementations. The messageclass includes return methods for array and message objects,respectively.

In various implementations the return methods for message objects andarray objects operate as follows. If the field already exists in themessage invoking the return method, the object (that is, the message orarray) held by the field is returned. If the field is inactive (that is,the active flag of the entry object corresponding to the field ID iscleared)—for example, due to the parent message having been recycled—thefield is activated (that is, the active flag is set) and the message orarray is cleared.

For example, a clear( ) method may be defined for the message class,which clears the active flag for each entry of the entry array in themessage. In various implementations, the clear method iterates throughevery entry of the array of entries and clears the active flag of each.In other implementations, the clear method only iterates through thelinked list of active entries and clears their active flags. Further,the first active pointer for the message object may be set to null.

Pooling

FIG. 12 is a graphical illustration of memory management according tothe prior art, such as may be implemented in the JAVA programminglanguage. Heap memory is unassigned memory available to the applicationand is indicated graphically at 800. Meanwhile, allocated memory isindicated graphically at 804.

At 808, a message with token A is created by allocating a first messageconfigured according to token A from the heap memory 800. This firstmessage is graphically indicated, at 812-1, moving from the heap memory800 to the allocated memory 804. At 816, a message of token B iscreated. A message 812-2 is shown being allocated from the heap memory800 to the allocated memory 804. At 820, the second message is no longerneeded and is released. Eventually the memory occupied by the secondmessage will be returned to the heap memory 800 by garbage collection.Even though the garbage collection may not occur immediately, themessage is shown going back to the heap memory 800 at 812-3.

At 824, another message of token B is created as indicated at 812-4. At828, another message of token A is created and is illustrated at 812-5.At 832, message 1 is no longer needed and is therefore released. Again,while not necessarily occurring immediately, message 1 is eventuallygarbage collected into the heap memory 800 as depicted at 812-6. At 836,another message of token A is created as indicated at 812-7. Note thateach message object is allocated from the heap memory 800 and thenreturned to the heap memory 800 via garbage collection.

FIG. 13 is a graphical illustration of an implementation of memorymanagement according to the present disclosure. Note that, while thesame sequence of object usage as in FIG. 12 is shown, the high processoroverhead (and potential pausing or stalling of the application) ofgarbage collection is no longer incurred. While pooling in a way that ishigh performance may not be difficult to someone having the benefit ofthis disclosure, and pooling in a way that is thread-safe may similarlynot be difficult, various implementations of the particular poolingapproach disclosed here have the unique property that thread safety ismaintained while high performance is achieved.

At 850-1, a message of type A (that is, having token A) is requested. At850-2, a message of type B is requested. At 850-3, the first type Bmessage instance is no longer needed and is therefore recycled. At850-4, another type B message is requested. At 850-5, another message oftype A is requested. At 850-6, the first type A message instance is nolonger needed and is therefore recycled. At 850-7, yet another messageof type A is requested.

In FIG. 13 , three functional groupings are shown: message objects inuse 854, a token A message pool 858, and a token B message pool 862.These three all represent allocated memory and, although messages areshown moving between the three, there is no actual movement in memory.Instead, these are a functional reassignments, not moves within memory.

At 850-1, there are no messages in the token A message pool 858 andtherefore a new message of type A is allocated from the heap memory 800.This first instance of message A is indicated at 870-1. At 850-2, amessage of type B is needed. Because the token B message pool 862 doesnot contain a message, a message of type B is allocated from the heapmemory 800 and shown at 874-1. At 850-3, the first instance of the typeB message is no longer needed and is therefore recycled. Recyclinginvolves assigning the message to the token B message pool 862, and thisassignment is graphically shown at 874-2.

At 850-4, a message of type B is needed and can be supplied from thetoken B message pool 862. At the time of reuse, the message is cleared.As described above, clearing may involve setting the active flag foreach of the entries of the message object to false. The resultingcleared message, shown at 874-3 can then be reused. At 850-5, there areno message objects in the token A message pool 858 and therefore a newmessage of type A is allocated from the heap memory 800 and is depictedat 878-1.

In 850-6, the first instance of the type A message is no longer neededand is therefore recycled. This recycle process is illustrated at 870-2by placing the first instance of message A into the token A message pool858. At 850-7, a message of type A is requested and, being present inthe token A message pool 858, is supplied. Again, the message is clearedfor re-use and the cleared message is now shown at 870-3.

Although clearing the message upon re-use is shown, in variousimplementations, the message may be cleared at the time of recycling. Invarious implementations, the message is cleared upon re-use: however, ifa quiescent period or period or low activity is experienced, messages inthe message pools may be cleared to lower the computational burden for atime when activity increases.

FIG. 14 , a flowchart illustrates a thread-safe process for requesting anew object from a pooled memory manager architecture. Control begins at900 in response to a request for a new object (such as a request for anew message object). At 900, control selects the relevant memory managerbased on the identity of the current thread. In other words, in variousimplementations, each thread may have its own set of memorymanagers—also referred to as pool containers.

At 904, control determines whether there are multiple pools for theobject in the memory manager and, if so, selects the applicable pool.For example, the selection of the relevant pool may be based on anobject token, such as a message token—in various implementations, thereis a pool for each message token in a memory manager for the thread. Inother examples, the relevant pool may be selected based on size, such asis the case when arrays of different sizes are pooled separately.

At 908, control determines whether the selected pool includes at leastone object. If so, control transfers to 912; otherwise, controltransfers to 916. At 916, there is no available object in the pool andtherefore a new object is generated by allocating memory from the heap.The object is assigned to the selected pool, such as by setting anelement of the object's data structure to an identifier of the selectedpool. The new object is then ready and control ends.

At 912, control selects the first object from the selected pool. Invarious implementations, the pool is implemented as a linked list andtherefore the first object is selected by following the head pointer ofthe pool. In other words, the pool ask as a LIFO (last in first out)data structure or stack. When the linked list is empty (there are noobjects in the linked list), the head pointer may be set to a nullvalue.

At 920, control retrieves the next object pointer from the selectedobject. This pointer may be null if there is no second object in thepool to form the next link in the linked list. Next, an atomic operationis performed at 924. The atomic operation is necessary to make sure thatan object is not being returned to the pool at the same time that anobject is being taken from the pool.

The atomic operation 924 includes, in the example of FIG. 14 , a testcondition and a set operation. The test condition is depicted at 928 andthe set operation is depicted at 932. At 928, control compares the headpointer of the pool to the pointer of the selected object. If they stillmatch, indicating that a new object has not been recycled and placed inbetween the head pointer and the selected object in the linked list,control continues at 932; otherwise control exits the atomic operation924 without performing the set operation. Upon exit, control returns to912. At 932, control is assured to be pointing to the first object inthe linked list and therefore control updates the head pointer to pointto the next object pointer, thereby removing the first object from thelink list. As mentioned above, the next object pointer may be null,which results in the linked list having zero entries.

Control then continues at 936, where the object state is cleared. For amessage object, clearing its state may include iterating over the linklist of top-level entries and clearing the activity flag for each.Control then ends. If the object state does not need to be cleared, suchas if clearing state is not relevant for the object or if state waspreviously cleared (such as at the time of recycle), control may omit936.

After obtaining a message object, set( ) and return( ) methods may beused to add values to entries of the message object. For example,primitive entries (such as integers, characters, etc.) may be populatedusing a set( ) method. The set( ) method writes a provided value to thevalue parameter of the entry and, as necessary, sets the hasValue flagfor that entry to true.

Object entries may be populated using a return( ) method rather than aset( ) method. For a message entry, the return( ) method may be definedto work as follows:

-   If the entry already exists, the message is returned; if the entry    is inactive (due to the parent message being recycled) the entry is    activated, and the message is cleared.-   If the entry does not exist, one is created, and set as entry in the    parent message.-   After the message is returned, it may be updated with the new state.-   Thus, once a message entry is initially created, it can continue to    be used, even after the parent message is recycled.

The behavior of the return( ) method for an array entry may beequivalent.

At a high level, the present disclosure may implement each message typeas a unique data structure. The system creates the data structure thefirst time the message is used, and then reuses the existing structureafter that. That ensures that, after the first use, setting the messagestate is only a matter of setting primitive values in the existingstructure—along with possibly resizing arrays, if the existing array istoo small; in time, the arrays should be sufficiently large.

The return methods are employed to enable this behavior—the structure iscreate on the first use, and reused thereafter. This is the motivationfor pooling by message type—it ensures that messages pulled from thepool will already have the required structure.

In FIG. 15 , example operation of a thread-safe process for recycling anobject is shown. Control begins at 950 in response to an object nolonger being needed. For example, a message object may have been encodedand sent out over the communications network and the message object istherefore no longer needed. At 950, control selects the relevant poolbased on the pool identifier in the object.

At 954, control sets the next pointer of the object to the value of thehead pointer of the selected pool. This will insert the recycled objectat the beginning of the linked list. However, before updating the headpointer of the pool to point to the recycled object, a thread-safeprocess performs an atomic operation 958.

Within the atomic operation 958, a condition 962 compares the nextpointer of the object to the head pointer of the selected pool. If thesevalues still match, no additional object has been recycled since 954 andtherefore control continues to 966 to complete the insertion of therecycled object into the linked list. This is accomplished by updatingthe head pointer to point to the recycled object. Control then ends.However, if the head pointer of the selected pool no longer points tothe next pointer of the object, this means another object has beenrecycled and therefore control returns to 954 to make sure that theobject will be placed at the beginning of the linked list withoutorphaning the newly recycled object.

Custom Arrays

FIGS. 16A-16D illustrate custom classes for use in the messagingarchitecture. Specifically, one or more custom sets of array classes maybe defined that expand upon the capabilities of built-in arraysavailable through the high-level language. Each set of custom arrayclasses may be implemented as a set of enclosing classes, one for eachdata type (for example, the data types shown at 680 in FIG. 9 , such ascharacter, integer, float, etc.), based on a nested class (which mayfurther be an inner class).

FIGS. 16A and 16B demonstrate two objects from a set of classes thatoffers resizable arrays as well as rapid comparisonmethods—specifically, example character and integer data types areshown. In addition to providing resizing functionality, these customarray classes may expose convenience methods, such as hashCode( ) andequals( ). They may be used with, for example, the string store module336. As described below, the hashCode( ) method may allow a rapidcomparison—if hashes do not match, the arrays are definitely not equal.If the hashes do match, the arrays may be equal, and their equality canbe checked with the equals( ) method.

In FIG. 16A, a character array object 1004 of a custom character arrayclass includes a length variable 1008 (which may be an integer), a hash1012 (which may also be an integer), and a backing character array 1016.In various implementations, the size of the backing character array 1016is defined to have a size that is a power of two. Further, the size isgreater than or equal to the value stored in the length variable 1008.As a numeric example, the size may be 64 (2⁶). Meanwhile, the lengthvariable 1008 may be less than 64: in one specific example, the lengthmay be 40. Continuing this example, the length of the character arrayobject 1004 can be increased from 40 up to as high as 64 without anychange to the backing character array 1016.

Once the length exceeds the size, a new backing character array iscreated, as described in more detail in FIG. 17 . In brief, the exponentN is determined (for example, using a base 2 logarithm and ceilingfunction) such that 2^(N) exceeds the length. A new backing array isthen created with size 2^(N). The values in the old backing array arecopied over and the old backing array is returned to the heap. Ineffect, the backing array allows for the longest character array thathas been encountered by this object to be stored even if the currentcharacter array that is being stored is much shorter.

The custom class may implement hashCode( ) and equals( ) methods relyingon the hash 1012, which may override standard hashCode( ) and equals( )methods. More specifically, the hashCode( ) method and equals( ) methodmay be implemented in such a manner that:

-   1. If hashCode( ) is used on the same object multiple times, and the    contents of the object have not changed, hashCode( ) returns the    same value each time.-   2. If the byte array properties of two or more objects have the same    contents, then equals( ) will return TRUE for any two of the two or    more objects.-   3. If two or more objects are equal to each other according to    equals( ), then hashCode( ) will return the same value for each of    the equal objects.

The hash 1012 may be calculated whenever data is changed in the backingcharacter array 1016. The hashCode( ) method may simply return the valueof the hash 1012. The equals( ) method may first compare hashes of twoobjects—if the hashes do not match, then the equals( ) method returns afalse value. If the hashes match, the equals( ) method may then comparelengths—a difference in lengths indicates that the arrays are not thesame. If the hashes and lengths match, the equals( ) method may performa value-by-value (or byte-by-byte) comparison of array elements toensure that the matching hashes are not the result of a hash collisionand instead are the result of each array element of the two objectsmatching. This equals( ) method may be more sophisticated than prior artbuilt-in equals( ) methods for array objects, which may identify twoobjects as being equal only if they are the exact same object (havingthe same reference).

In FIG. 16B, an example integer array object 1040 of a custom integerarray class is shown. Similar to the character array object 1004, theinteger array object 1040 includes a length 1044, a hash 1048, and abacking integer array 1052.

FIGS. 16C and 16D demonstrate two objects from a set of classes thatoffers resizable arrays—specifically, example character and integer datatypes are shown. These resizable arrays may be used for array content inmessage data structures (the message class) since, in variousimplementations, the hashCode( ) and equals( ) methods may not be neededor even relevant in that context. In FIG. 16C, an example characterarray object 1060 of a custom character array class is shown. Thecharacter array object 1060 includes a length 1064 (which may be aninteger) and a backing character array 1068 having a size that is apower of two and is greater than or equal to the length 1064.

In FIG. 16D, an example integer array object 1080 of a custom integerarray class is shown. The integer array object 1080 includes a length1084 (which may be an integer) and a backing integer array 1088 having asize that is a power of two and is greater than or equal to the length1084.

In FIG. 17 , an example process for adding elements to an array objectis shown. In response to new elements being present at the array object,control begins at 1100. Control determines whether the ultimate length(including the new elements) is greater than the size of the existingbacking array. If so, control transfers to 1104; otherwise, controltransfers to 1108.

At 1104, control determines a new backing array size. For example,control may calculate the base two logarithm of the ultimate length,apply the ceiling function to identify N, and then calculate 2^(N) toobtain the new backing array size. At 1112, control instantiates the newbacking array. At 1116, control copies the elements of the existingbacking array into the new backing array and releases the existingbacking array. Note that only the elements from the beginning of thearray up until the index of the array indicated by the length value needto be copied since the remainder of the backing array does not containvalid data.

At 1120, control updates the pool membership of the resized array objectin implementations where array objects are pooled based on backing arraysize. In various implementations, pool membership may be determined atthe time the array object is returned to a pool—in thoseimplementations, 1120 may be omitted. Control then continues at 1108.

At 1108, control stores the new elements into the backing array. At1124, control updates the length field of the array object to reflectthe new elements. Control then ends.

In FIG. 18 , a flowchart illustrates example operation of servicing arequest for an array object. In response to the request, control beginsat 1200. At 1200, control determines a backing array exponent for therequested array object. For example, a base two logarithm of the desiredlength for the array is calculated and a ceiling function is applied. Avariable called pool size is set to this calculated backing arrayexponent.

At 1204, control determines whether a pool exists for (i) the array typespecified in the request as well as (ii) the size specified by the poolsize variable. If so, control transfers to 1208; otherwise, controltransfers to 1212. At 1208, control selects the pool for the array typein the backing array size. Control then continues at 1216, where controldetermines whether the selected pool has at least one array object. Ifso, control transfers to 1220; otherwise, control transfers to 1212.

At 1220, control obtains the first array object from the selected pool.In various implementations, this may be performed in a thread-safemanner such as is illustrated in FIG. 14 . Control then continues at1224, where the array object is returned. At 1212, control determineswhether there are any pools with a larger size than the selected pool.If so, control transfers to 1228; otherwise, control transfers to 1232.

At 1232, there are no pools that have an array of sufficient size andtherefore control creates a new array object with a backing array ofsize 2 raised to the power of the originally calculated backing arraysize. Control then continues at 1224. At 1228, a larger pool than iscurrently selected does exist and therefore the pool size isincremented. Control then continues at 1224.

Parsing

FIGS. 19 and 20 illustrate example operation of encoding according to aplenary approach and a dictionary approach, respectively. The plenaryapproach explicitly defines the fields of the message, including theirfield IDs and data types, in the encoded bytes. Meanwhile, thedictionary approach uses a dictionary definition that specifies thefield IDs and types and therefore this definitional information does notneed to be included in the encoded bytes. Encoding and decoding may alsobe referred to as parsing.

Encoding using the dictionary definition allows the encoded messages tobe smaller, improving bandwidth efficiency, and is also faster becausefewer pieces of information need to be encoded and transmitted.Dictionary directed parsing facilitates the efficient publishing of thefull set of message fields. This may be particularly useful whenpublishing over UDP. If the full set of fields is published, and thereis a UDP packet drop, the consumer can receive the full current state assoon as it receives the next message. This decreases the need for nacks(non-acknowledgements). Further, dictionary directed parsing is timeefficient and, because it yields smaller encodes, it decreases thenumber of packets needed and therefore the likelihood of drops.

In various implementations, plenary and dictionary directed parsing aredifferent implementations of the same interface. An example of such aninterface is presented here:

  public interface Parser { // Send side methods public intencode(Message msg) ; public int readMsgBytes(byte[ ] bytes, intoffset); public int bytesRemaining( ); public boolean fullyRead( ); //Receive side methods public boolean writeMsgBytes(byte[ ] bytes, intoffset, int length); public boolean readyToParse( ); public Messageparse( ); // Send side, optional value set at startup public voidsetCompressAt(int numBytes); // Allows the parser state to be reset, incase it enters a bad state // e.g., receives a message it can't parsepublic void reset( ); }

The encode( ) method encodes the message state into bytes in the bytequeue and returns the size of the encode (that is, how many bytes werewritten to the byte queue).

The readMsgBytes( ) method reads the encoded message from the byte queueand returns the number of bytes written to the byte array. On both theread and write side, dipping in a byte array enables efficient movementof bytes to and from sockets. The byte array can be the data array in adatagram packet (for UDP), or the backing array of an array buffer (forTCP).

The bytesRemaining( ) method returns the number of bytes in the bytequeue still to be written to the socket.

The writeMessageBytes( ) method writes received bytes from the socket tothe parser.

The readyToParse( ) method returns a value indicating whether the bytesof a full message are waiting in the byte queue.

The parse( ) method converts the bytes in the byte queue into a message.

The setCompressAt( ) method establishes a threshold value. If an encodesize of a message exceeds the threshold value, the message is compressedprior to sending.

In FIG. 19 , control begins at 1300, where control writes a number ofelements to a byte queue. These elements include a startup messageindicator, a length placeholder (which may be defined by number ofbytes, number fields, or both), the message token, and a header. Theheader may include a topic for a publication and/or a request ID for apoint-to-point communication. The length is a placeholder because thelength is determined throughout the course of encoding and can then befilled into the placeholder area at the end of encoding. This is farmore efficient than iterating through the message an initial time todetermine the length prior to beginning encoding.

At 1304, control selects the first field of the message using the linkedlist structure of the message. At 1308, control writes the field ID andfield type of the selected field to the byte queue. At 1312, controldetermines whether the field type is a message and, if so, controltransfers to 1316; otherwise, control transfers to 1320. At 1320,control determines whether the field type is an array and, if so,control transfers to 1324; otherwise, control transfers to 1328.

At 1328, the field value is a primitive data type and control writes thefield value to the byte queue. Meanwhile, at 1316, the field type is amessage and therefore the message is encoded into the byte queue. Themessage is encoded in the byte queue in a recursive form such that FIG.19 can be used to encode this sub message. However, when recursivelycalling FIG. 19 , the initial step of 1300 may be modified, such as byexcluding the header. After encoding the message and the byte queue,control continues at 1332. At 1324, control encodes the array into thebyte queue. For example, this encoding may be performed as shown in FIG.21 . Control then continues at 1332.

At 1332, control determines whether the last message field in the linkedlist is selected. If so, control transfers to 1336; otherwise, controltransfers to 1340. At 1340, control selects the next field of themessage and continues at 1308. At 1336, control writes an end of messageindicator to the byte queue. At 1334, control writes the length into theplaceholder location in the byte queue established at 1300. Control thenends.

In FIG. 20 , operation of the dictionary encoding begins at 1400. Invarious implementations, 1400 may be implemented similarly oridentically to 1300 of FIG. 19 . Control continues at 1460, wherecontrol selects the first field from the dictionary definition for themessage token. In other words, the dictionary definition specifies theorder of the fields according to field IDs. The first field is thereforeselected by using the field ID to directly access the field.

Elements 1412, 1416, 1420, 1424, and 1428 may be implemented similarlyto or identically to elements 1312, 1316, 1320, 1324, and 1328 of FIG.19 . Note that the field values are written to the byte queue at 1428exclusive of the data type or field identifier of the field: in otherwords, the data type and the field identifier are omitted.

At 1464, control determines whether the last message field is selected.However, the dictionary definition specifies the final message fieldrather than the linked list in the message object. If the last field hasbeen selected, control transfers to 1436; otherwise, control transfersto 1468. At 1468, control selects the next field of the messageaccording to the dictionary definition and returns to 1412. In variousimplementations, 1436 and 1444 may be implemented similarly to oridentically to 1336 and 1344 of FIG. 19 .

In FIG. 21 , example encoding of an array begins at 1500. At 1500,control determines whether plenary or dictionary encoding is being used.If plenary encoding is being used, control transfers to 1504; otherwise,control transfers to 1508. At 1504, control writes an indicator of thedata type of the array to the byte queue and continues at 1508. This isnot necessary for dictionary-directed encoding.

At 1508, control writes an indicator of the array size to the byte queueand selects the first element of the array. At 1512, control writes theselected array element into the byte queue. If the array element is aprimitive type, this is straightforward. However, if the array elementis a message, the message may be encoded as shown in FIG. 19 or 20(depending on whether dictionary directed or plenary encoding is beingused). If the array element is yet another array, FIG. 21 may be invokedrecursively.

Control continues at 1516, where if the last array element is selected,control ends; otherwise, control transfers to 1520. The last element ofthe array is determined based on the specified length even if thebacking array is longer. At 1520, control selects the next element ofarray and returns to 1512.

Transmission and Reception

In FIG. 22 , a flowchart depicts operation for transmitting a messageusing the UDP protocol. Transmission of the message may be under controlof the business logic. The system may offer both TCP and UDP transportmechanisms that can be selected by the business logic. When the protocolis TCP, splitting a larger message into individual packets may behandled by the networking stack using segmentation and/or fragmentation.

Control begins at 1600, where in some implementations an empty bytequeue is initialized. For example only, the byte queue may be a reusableobject used for each encode—or a thread-local object that is used foreach encode performed by that thread. When the object is reused, it willgenerally be cleared before reuse—either immediately before reuse orearlier, such as immediately after the previously encoded message hasbeen transmitted. In various implementations, clearing may involvesimply setting the length to 0, thereby designating any existing data inthe byte queue as invalid.

At 1604, control encodes the message into the byte queue as shown inFIGS. 19 and 20 . Encoding may provide information about the size of thebyte queue, which can be used to determine whether the message can besent in a single packet (that is, UDP datagram) or not. At 1608, controlsets a destination for the packet(s). For example, this may be a unicastor multicast address. The multicast address and port number may bedictated by the topic identifier of the message. A unicast address maybe determined based on a callback received in a previous messagepublished to a topic the device subscribes to.

A packet object may be used for constructing each packet fortransmission. For example, the packet object may be thread-local andreused for each packet constructed and sent by the present thread. Invarious implementations, the packet object includes a destination field,a data array, and a length. The destination field may include an address(unicast or multicast) and a port number. The length indicates theamount of valid data in the data array—for example, measured in numberof bytes. At 1608, control sets the destination for the message into thedestination field of the packet object.

At 1612, if the size of the byte queue (which may have been reported aspart of encoding at 1604) is greater than a predefined threshold(represented as X−1), control transfers to 1614 to send multiplepackets; otherwise, control transfers to 1620 to send a single packet.The value of X is a configuration parameter based on the networkinterface. For example, X may be the maximum payload size of a UDPpacket in the local network—if different segments of the network allowdifferent payload sizes, the smallest of these sizes may be selected asX so that X represents the largest data payload available through theentire network.

A specified value (in the example shown, this value is 1) may besubtracted from X for the comparison to allow for “header data” toprecede the actual message data (the byte queue). The term “header data”is in quotes because it may not be a packet header as understood by thenetworking stack and networking devices in the network. Instead, theterm “header data” is included in the payload of the packet and used bythe recipient to interpret the rest of the payload data. In variousimplementations, the header data for a single-packet message may be asingle byte (such as the value 0) to indicate that the packet containsthe entirety of the message. In such implementations, the value 1 issubtracted from X for the comparison of 1612.

At 1620, the byte queue will fit within a single packet and so thesingle-packet header data (such as a single-byte 0) is placed at thebeginning of the packet data array. Control continues at 1624.

At 1614, the byte queue will span multiple packets, so controldetermines the total number of packets needed. For example, thisdetermination may be made by subtracting the multi-packet header datasize from X and dividing the byte queue size by the result, thenapplying the ceiling function (which chooses the smallest integer thatis greater than or equal to its input).

At 1616, control writes multi-packet header data to the beginning of thepacket data array. For example, the header data may include a messageID, total number of packets (determined at 1614), and the number of thecurrent packet (a counter beginning at either 0 or 1). Whichever fieldis placed first in the packet data array may need to be chosen such thatthe beginning of the packet data array is differentiated from thebeginning that would have been written at 1620. For example, if 1620uses a single-byte 0 to indicate a single-packet message, the first byteof the header data in 1616 may be constrained to be non-zero.

The message ID may be unique to messages sent by the sending device, atleast within a given timespan, such as 1 hour or 24 hours—that is, thesame message ID is not reused within the given timespan. In variousimplementations, no mechanism is implemented to ensure the message ID isunique across all senders—as a result, the message ID may be combinedwith some other indicia (such as sender IP address) to unambiguouslyidentify a set of packets related to a single message. Control thencontinues at 1624.

At 1624, control sets a start position for the packet data array to alocation following (in various implementations, immediately following)the header data. This start position may differ according to whethersingle-packet or multi-packet header data was written to the packet dataarray.

At 1628, control copies bytes from the byte queue into the packet dataarray, beginning at the start position of the packet data array. Thecopy ends when either the byte queue is exhausted or the end of thepacket data array is reached.

At 1632, control specifies the length of valid data in the packet dataarray. For example, the length may be stored as a field in the packetobject. The length may be a sum of the number of bytes in the headerdata and the number of copied bytes.

At 1636, control sends the packet object to a UDP network socket forprocessing and transmission by the networking stack. At 1640, controldetermines whether all of the bytes in the byte queue have been copied.If so, control ends; otherwise, control returns to 1616. Thisdetermination may be made, in various implementations, based on a flagreturned by the copy process of 1628. For example, the flag may indicatewhether all the bytes of the byte queue have been copied. In otherimplementations, the determination may be made by comparing a currentposition variable of the byte queue to a length of the byte queue. Thecurrent position variable may keep track of the last byte copied fromthe byte queue to enable the next copy to resume copying from thefollowing byte.

Before ending, control may decide whether to retain the byte queue. Ifmultiple packets were sent (the “Y” branch of 1612), the byte queue maybe retained to allow for missing packets to be re-sent. In variousimplementations, the re-request protocol will request missing packetsafter a defined period of time in which fewer than all packets for amessage were received. The control of FIG. 22 may therefore retain thebyte queue until this defined period of time has elapsed. Specifically,the byte queue may be retained for the defined period of time plus atransmission delay to allow for any delay in one of the packets reachingthe destination and for the re-request arriving.

If only a single packet was sent (the “N” branch of 1612), no re-requestwill occur and therefore the byte queue can immediately be returned tothe appropriate pool for reuse. In various implementations, while thedata in the byte queue is not immediately overwritten, it is no longerconsidered valid data. In fact, freeing the byte queue for reuse as partof transmission may be performed after 1628 rather than waiting untilafter 1636 or 1640.

While not illustrated, a system according to the principles of thepresent disclosure may combine multiple messages going to a commondestination into a single packet, which may be referred to as bursting.The system may have a transmit buffer that holds an encoded message fora configurable period of time. If, within that time, further messagesare encoded that can be transmitted with the first message—that is, thedestinations are the same and the combined size remains within the sizeof one packet, a combined packet is created and sent.

In FIG. 23 , example receive operation for a UDP implementation beginsat 1700. At 1700, control reads header data from the packet payload. Ifthe packet contains the entirety of one or more messages, the headerdata may be a predetermined indicator. If the packet is part of amulti-packet transmission, the header data may include a message ID, thetotal packet count for this message ID, and the number of this packet.As one example, the predetermined indicator may be a single-byte 0 valuewhile the first byte of the header data for a multi-packet transmissionis constrained to be non-zero. At 1704, if the packet is part of amulti-packet message, control transfers to 1708; otherwise, controltransfers to 1712.

At 1712, the single-packet message is ready for decoding and thereforethe packet contents are copied into a byte queue. Control continues at1716, where a message object is requested from the pool according to thetoken of the message. At 1720, control decodes the byte queue into themessage object and control ends. 1716 and 1720 may collectively bereferred to as a parse operation 1724.

At 1708, control looks for an existing multi-packet object based on themessage ID. If the message IDs are not globally unique, the look-up maydisambiguate message IDs with indicia such as a source address of thepacket. For example, control may look up the multi-packet object basedon a combination of message ID and internet protocol (IP) address.

At 1728, if the multi-packet object already exists, control transfers to1732; otherwise, control transfers to 1736. At 1736, the object does notyet exist and therefore a multi-packet object is requested from a pool.Control sets a packet count field within the multi-packet object andsets the remaining packet count equal to the packet count. Control thencontinues at 1732.

At 1732, control determines whether the array entry for the specifiedpacket number in the multi-packet object has a length of zero. If so,that means that the packet contents have not yet been received andtherefore control transfers to 1740. However, if the array entry is anonzero length, this packet number has already been received andprocessed and therefore control transfers immediately to 1744 (ignoringthe newly received packet). At 1740, control copies the packet contentsinto the multi-packet array entry for the specified packet number.Control then continues at 1748, where control decrements the remainingpacket count. Control then continues at 1744.

At 1744, if the remaining packet count has reached zero, all the packetsfor this multi-packet message have been received. If all of the packetshave been received, control transfers to 1752; otherwise, control ends.At 1752, all of the packets have been received and therefore the arraysin the multi-packet object are copied, in order, into the byte queue.Control then continues at 1716 to decode the byte queue.

FIG. 24 is a flowchart of example re-request operation for a UDPimplementation. Note that re-requesting is only performed formulti-packet messages. The business logic is responsible for ensuringthat a message is received if necessary. UDP is frequently used whenhigh-volume data with time sensitivity is present. In such a case, 100percent reception may not be desirable. Instead, the data may bereceived soon after, rendering a retransmission obsolete or at leastless desirable. Further, the present disclosure avoids the deleteriouseffects of nack storms.

In various implementations, control begins on a periodic basis at 1800.At 1800, control selects the first active multi-packet object of theactive multi-packet objects. At 1804, control determines whether atimestamp of the multi-packet packet object is older than a definedre-request period. If so, control transfers to 1808; otherwise, controltransfers to 1812. The timestamp of the multi-packet is updated eachtime that a packet is received for the multi-packet. Therefore, thetimestamp indicates how recently a packet has been received for thismulti-packet message.

At 1808, the re-request period has expired and control thereforeconsiders whether sending a re-request is desirable. First, at 1808,control determines whether the timestamp is older than a timeout period.If so, control transfers to 1812; otherwise, control transfers to 1816.The timeout period is set such that a very old multi-packet is discardedunder the assumption that it will not be completed. The timeout periodmay be a multiple of the re-request period, such as six times longer orten times longer. At 1812, the selected multi-packet has timed out andtherefore the selected multi-packet object is recycled. Control thencontinues at 1814.

At 1816, the multi-packet has not yet timed out and so controldetermines whether a re-request should be sent. Each multi-packet objectmay have a re-request counter and therefore control determines whether are-request counter has reached a defined number N of re-requests. If so,further requests are not sent and control transfers to 1814; otherwise,control transfers to 1820 to send a re-request. In variousimplementations, the number N may be set to one; then, the re-requestcounter may be implemented as a Boolean, with false indicating that there-request is not performed and true indicating that a re-request hasalready been performed.

At 1820, control transmits a re-request to the source of themulti-packet message. The re-request includes the message ID. To preventthe transmission of every packet, the re-request may include a list ofthe numbers of the missing packets. In other implementations, the listmay be a bitfield with a first value (such as 1) for every receivedpacket and a second value (such as 0) for every packet not yet received.Control continues at 1824. At 1824, control increments the re-requestcounter and continues at 1814. At 1814, control determines whether thelast multi-packet object is currently selected. If so, control ends;otherwise, control returns to 1828. At 1828, control selects the nextactive multi-packet object and continues at 1804.

CONCLUSION

The foregoing description is merely illustrative in nature and is in noway intended to limit the disclosure, its application, or uses. Thebroad teachings of the disclosure can be implemented in a variety offorms. Therefore, while this disclosure includes particular examples,the true scope of the disclosure should not be so limited since othermodifications will become apparent upon a study of the drawings, thespecification, and the following claims. It should be understood thatone or more steps within a method may be executed in different order (orconcurrently) without altering the principles of the present disclosure.Further, although each of the embodiments is described above as havingcertain features, any one or more of those features described withrespect to any embodiment of the disclosure can be implemented in and/orcombined with features of any of the other embodiments, even if thatcombination is not explicitly described. In other words, the describedembodiments are not mutually exclusive, and permutations of one or moreembodiments with one another remain within the scope of this disclosure.

Spatial and functional relationships between elements (for example,between modules) are described using various terms, including“connected,” “engaged,” “interfaced,” and “coupled.” Unless explicitlydescribed as being “direct,” when a relationship between first andsecond elements is described in the above disclosure, that relationshipencompasses a direct relationship where no other intervening elementsare present between the first and second elements, and also an indirectrelationship where one or more intervening elements are present (eitherspatially or functionally) between the first and second elements. Thephrase at least one of A, B, and C should be construed to mean a logical(A OR B OR C), using a non-exclusive logical OR, and should not beconstrued to mean “at least one of A, at least one of B, and at leastone of C.”

In the FIGS., the direction of an arrow, as indicated by the arrowhead,generally demonstrates the flow of information (such as data orinstructions) that is of interest to the illustration. For example, whenelement A and element B exchange a variety of information butinformation transmitted from element A to element B is relevant to theillustration, the arrow may point from element A to element B. Thisunidirectional arrow does not imply that no other information istransmitted from element B to element A. Further, for information sentfrom element A to element B, element B may send requests for, or receiptacknowledgements of, the information to element A. The term subset doesnot necessarily require a proper subset. In other words, a first subsetof a first set may be coextensive with (equal to) the first set.

In this application, including the definitions below, the term “module”or the term “controller” may be replaced with the term “circuit.” Theterm “module” may refer to, be part of, or include processor hardware(shared, dedicated, or group) that executes code and memory hardware(shared, dedicated, or group) that stores code executed by the processorhardware.

The module may include one or more interface circuits. In some examples,the interface circuit(s) may implement wired or wireless interfaces thatconnect to a local area network (LAN) or a wireless personal areanetwork (WPAN). Examples of a LAN are Institute of Electrical andElectronics Engineers (IEEE) Standard 802.11-2016 (also known as the WWIwireless networking standard) and IEEE Standard 802.3-2015 (also knownas the ETHERNET wired networking standard). Examples of a WPAN are IEEEStandard 802.15.4 (including the ZIGBEE standard from the ZigBeeAlliance) and, from the Bluetooth Special Interest Group (SIG), theBLUETOOTH wireless networking standard (including Core Specificationversions 3.0, 4.0, 4.1, 4.2, 5.0, and 5.1 from the Bluetooth SIG).

The module may communicate with other modules using the interfacecircuit(s). Although the module may be depicted in the presentdisclosure as logically communicating directly with other modules, invarious implementations the module may actually communicate via acommunications system. The communications system includes physicaland/or virtual networking equipment such as hubs, switches, routers, andgateways. In some implementations, the communications system connects toor traverses a wide area network (WAN) such as the Internet. Forexample, the communications system may include multiple LANs connectedto each other over the Internet or point-to-point leased lines usingtechnologies including Multiprotocol Label Switching (MPLS) and virtualprivate networks (VPNs).

In various implementations, the functionality of the module may bedistributed among multiple modules that are connected via thecommunications system. For example, multiple modules may implement thesame functionality distributed by a load balancing system. In a furtherexample, the functionality of the module may be split between a server(also known as remote, or cloud) module and a client (or, user) module.For example, the client module may include a native or web applicationexecuting on a client device and in network communication with theserver module.

The term code, as used above, may include software, firmware, and/ormicrocode, and may refer to programs, routines, functions, classes, datastructures, and/or objects. Shared processor hardware encompasses asingle microprocessor that executes some or all code from multiplemodules. Group processor hardware encompasses a microprocessor that, incombination with additional microprocessors, executes some or all codefrom one or more modules. References to multiple microprocessorsencompass multiple microprocessors on discrete dies, multiplemicroprocessors on a single die, multiple cores of a singlemicroprocessor, multiple threads of a single microprocessor, or acombination of the above.

Shared memory hardware encompasses a single memory device that storessome or all code from multiple modules. Group memory hardwareencompasses a memory device that, in combination with other memorydevices, stores some or all code from one or more modules.

The term memory hardware is a subset of the term computer-readablemedium. The term computer-readable medium, as used herein, does notencompass transitory electrical or electromagnetic signals propagatingthrough a medium (such as on a carrier wave); the term computer-readablemedium is therefore considered tangible and non-transitory. Non-limitingexamples of a non-transitory computer-readable medium are nonvolatilememory devices (such as a flash memory device, an erasable programmableread-only memory device, or a mask read-only memory device), volatilememory devices (such as a static random access memory device or adynamic random access memory device), magnetic storage media (such as ananalog or digital magnetic tape or a hard disk drive), and opticalstorage media (such as a CD, a DVD, or a Blu-ray Disc).

The apparatuses and methods described in this application may bepartially or fully implemented by a special purpose computer created byconfiguring a general purpose computer to execute one or more particularfunctions embodied in computer programs. The functional blocks andflowchart elements described above serve as software specifications,which can be translated into the computer programs by the routine workof a skilled technician or programmer.

The computer programs include processor-executable instructions that arestored on at least one non-transitory computer-readable medium. Thecomputer programs may also include or rely on stored data. The computerprograms may encompass a basic input/output system (BIOS) that interactswith hardware of the special purpose computer, device drivers thatinteract with particular devices of the special purpose computer, one ormore operating systems, user applications, background services,background applications, etc.

The computer programs may include: (i) descriptive text to be parsed,such as HTML (hypertext markup language), XML (extensible markuplanguage), or JSON (JavaScript Object Notation), (ii) assembly code,(iii) object code generated from source code by a compiler, (iv) sourcecode for execution by an interpreter, (v) source code for compilationand execution by a just-in-time compiler, etc. As examples only, sourcecode may be written using syntax from languages including C, C++, C#,Objective C, Swift, Haskell, Go, SQL, R, Lisp, Java®, Fortran, Perl,Pascal, Curl, OCaml, JavaScript®, HTML5 (Hypertext Markup Language 5threvision), Ada, ASP (Active Server Pages), PHP (PHP: HypertextPreprocessor), Scala, Eiffel, Smalltalk, Erlang, Ruby, Flash®, VisualBasic®, Lua, MATLAB, SIMULINK, and Python®.

1. A computationally-efficient encoding system for encoding a messageobject, the system comprising: memory hardware configured to storeinstructions; and processing hardware configured to execute theinstructions stored by the memory hardware, wherein the instructionsinclude: determining a token of the message object, wherein the tokenidentifies a structure of the message object; obtaining a dictionarydefinition based on the token, wherein: the dictionary definitiondescribes the structure of the message, the message includes a pluralityof entries, each of the plurality of entries is characterized by a datatype and a field identifier, and the dictionary definition defines anorder of the plurality of entries; according to an order specified bythe dictionary definition, selecting each entry of a plurality ofentries in the message in sequence and writing the entry to a byte queueexclusive of the data type and the field identifier; and initiatingtransmission of the byte queue over a communications network.
 2. Thesystem of claim 1 wherein the writing the entry to the byte queueincludes, in response to the entry being one of a set of primitive datatypes, writing a value of the entry to the byte queue.
 3. The system ofclaim 2 wherein the set of primitive data types includes Boolean, byte,char, short, int, long, float, and double.
 4. The system of claim 1wherein the writing the entry to the byte queue includes, in response tothe entry being an array: writing a length of the array to the bytequeue exclusive of a data type of the array; and writing each element ofthe array to the byte queue.
 5. The system of claim 1 wherein thewriting the entry to the byte queue includes, in response to the entrybeing a nested message, recursively performing the selecting and writingfor entries in the nested message.
 6. The system of claim 1 wherein: thedictionary definition defines, for each of the plurality of entries, adata type; and the dictionary definition defines, for each of theplurality of entries, a field identifier.
 7. The system of claim 1wherein the instructions include storing a plurality of dictionaryentries having a one-to-one relationship with a plurality of tokens. 8.The system of claim 7 wherein the instructions include synchronizing theplurality of dictionary entries with a dictionary server over thecommunications network.
 9. The system of claim 1 wherein initiatingtransmission of the byte queue includes: in response to the byte queuehaving a length less than or equal to a threshold, sending the bytequeue to a networking stack for transmission as a packet; and inresponse to the length of the byte queue exceeding the threshold,iteratively: obtaining, without replacement, a number of bytes less thanor equal to the threshold from the byte queue, and sending the obtainedbytes to the networking stack for transmission as a packet.
 10. Thesystem of claim 9 wherein the sending the obtained bytes to thenetworking stack includes sending a total packet count as well as acurrent packet number to the networking stack.
 11. The system of claim 9wherein the packet is one of a user datagram protocol (UDP) datagram anda transmission control protocol (TCP) segment.
 12. The system of claim 1wherein, in response to a transmission mode being user datagram protocol(UDP), initiating transmission of the byte queue includes: in responseto the byte queue having a length less than or equal to a threshold,sending first header data and the byte queue to a networking stack fortransmission as a packet; and in response to the length of the bytequeue exceeding the threshold, iteratively: obtaining, withoutreplacement, a number of bytes less than or equal to the threshold fromthe byte queue, and sending second header data and the obtained bytes tothe networking stack for transmission as a packet, wherein the firstheader data has a different length than the second header data, andwherein the first header data includes a fixed value indicating that anentirety of the message is contained in the packet.
 13. The system ofclaim 12 wherein: the first header data is a single byte; and the firstheader data consists of the fixed value.
 14. The system of claim 12wherein the second header data includes an identifier of the message, atotal number of packets, and a serial number of the packet with respectto the total number of packets.
 15. The system of claim 12 wherein thethreshold is based on a difference between (i) a largest UDP datapayload available throughout the communications network and (ii) thelength of the first header data.
 16. The system of claim 13 wherein, inresponse to the transmission mode being user datagram protocol (UDP),initiating transmission of the byte queue includes: in response to thelength of the byte queue being less than or equal to the threshold,freeing the byte queue for reuse immediately upon sending the byte queueto the networking stack; and in response to the length of the byte queueexceeding the threshold, retaining the byte queue for a definedre-request time before freeing the byte queue for reuse.
 17. The systemof claim 1 wherein: the system is configured to operate in twoselectable modes; the two selectable modes include a dictionary mode anda plenary mode; and the instructions include, in the plenary mode,according to an order established by the structure of the messageobject, selecting each entry of the plurality of entries in the messagein sequence and: writing the data type of the entry to the byte queue,writing the field identifier of the entry to the byte queue, and writingthe entry to the byte queue.
 18. The system of claim 17 wherein theorder in the plenary mode is established by a linked list of theplurality of entries.
 19. The system of claim 18 wherein: the messageobject includes a head pointer pointing to a first one of the pluralityof entries; and each of the plurality of entries has a next pointer toindicate a next entry in the linked list.
 20. Acomputationally-efficient encoding method for encoding a message object,the method comprising: determining a token of the message object,wherein the token identifies a structure of the message object;obtaining a dictionary definition based on the token, wherein: thedictionary definition describes the structure of the message, themessage includes a plurality of entries, each of the plurality ofentries is characterized by a data type and a field identifier, and thedictionary definition defines an order of the plurality of entries;according to an order specified by the dictionary definition, selectingeach entry of a plurality of entries in the message in sequence andwriting the entry to a byte queue exclusive of the data type and thefield identifier; and initiating transmission of the byte queue over acommunications network.
 21. A non-transitory computer-readable mediumcomprising instructions including: determining a token of the messageobject, wherein the token identifies a structure of the message object;obtaining a dictionary definition based on the token, wherein: thedictionary definition describes the structure of the message, themessage includes a plurality of entries, each of the plurality ofentries is characterized by a data type and a field identifier, and thedictionary definition defines an order of the plurality of entries;according to an order specified by the dictionary definition, selectingeach entry of a plurality of entries in the message in sequence andwriting the entry to a byte queue exclusive of the data type and thefield identifier; and initiating transmission of the byte queue over acommunications network.